-- Logs begin at Mon 2022-08-22 14:57:39 UTC, end at Mon 2022-08-22 16:12:31 UTC. -- Aug 22 15:35:44.346772 dv-cinder-842541-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 15:35:44.356788 dv-cinder-842541-5-smb devstack@keystone.service[98412]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 15:35:44.358816 dv-cinder-842541-5-smb devstack@keystone.service[98412]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 15:35:44 2022] *** Aug 22 15:35:44.358816 dv-cinder-842541-5-smb devstack@keystone.service[98412]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 15:35:44.358816 dv-cinder-842541-5-smb devstack@keystone.service[98412]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 15:35:44.358816 dv-cinder-842541-5-smb devstack@keystone.service[98412]: nodename: dv-cinder-842541-5-smb Aug 22 15:35:44.358816 dv-cinder-842541-5-smb devstack@keystone.service[98412]: machine: x86_64 Aug 22 15:35:44.358816 dv-cinder-842541-5-smb devstack@keystone.service[98412]: clock source: unix Aug 22 15:35:44.358816 dv-cinder-842541-5-smb devstack@keystone.service[98412]: pcre jit disabled Aug 22 15:35:44.358816 dv-cinder-842541-5-smb devstack@keystone.service[98412]: detected number of CPU cores: 4 Aug 22 15:35:44.358816 dv-cinder-842541-5-smb devstack@keystone.service[98412]: current working directory: / Aug 22 15:35:44.359408 dv-cinder-842541-5-smb devstack@keystone.service[98412]: detected binary path: /usr/bin/uwsgi-core Aug 22 15:35:44.359408 dv-cinder-842541-5-smb devstack@keystone.service[98412]: your processes number limit is 47680 Aug 22 15:35:44.359408 dv-cinder-842541-5-smb devstack@keystone.service[98412]: your memory page size is 4096 bytes Aug 22 15:35:44.359408 dv-cinder-842541-5-smb devstack@keystone.service[98412]: detected max file descriptor number: 2048 Aug 22 15:35:44.359408 dv-cinder-842541-5-smb devstack@keystone.service[98412]: lock engine: pthread robust mutexes Aug 22 15:35:44.359408 dv-cinder-842541-5-smb devstack@keystone.service[98412]: thunder lock: enabled Aug 22 15:35:44.359408 dv-cinder-842541-5-smb devstack@keystone.service[98412]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 15:35:44.359408 dv-cinder-842541-5-smb devstack@keystone.service[98412]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 15:35:44.400251 dv-cinder-842541-5-smb devstack@keystone.service[98412]: Python main interpreter initialized at 0x55cb787d99c0 Aug 22 15:35:44.400251 dv-cinder-842541-5-smb devstack@keystone.service[98412]: python threads support enabled Aug 22 15:35:44.400251 dv-cinder-842541-5-smb devstack@keystone.service[98412]: your server socket listen backlog is limited to 100 connections Aug 22 15:35:44.400251 dv-cinder-842541-5-smb devstack@keystone.service[98412]: your mercy for graceful operations on workers is 90 seconds Aug 22 15:35:44.400689 dv-cinder-842541-5-smb devstack@keystone.service[98412]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 15:35:44.400774 dv-cinder-842541-5-smb devstack@keystone.service[98412]: *** Operational MODE: preforking *** Aug 22 15:35:44.401038 dv-cinder-842541-5-smb devstack@keystone.service[98412]: *** uWSGI is running in multiple interpreter mode *** Aug 22 15:35:44.401038 dv-cinder-842541-5-smb devstack@keystone.service[98412]: spawned uWSGI master process (pid: 98412) Aug 22 15:35:44.401296 dv-cinder-842541-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 22 15:35:44.401861 dv-cinder-842541-5-smb devstack@keystone.service[98412]: spawned uWSGI worker 1 (pid: 98421, cores: 1) Aug 22 15:35:44.402174 dv-cinder-842541-5-smb devstack@keystone.service[98412]: spawned uWSGI worker 2 (pid: 98422, cores: 1) Aug 22 15:35:44.404661 dv-cinder-842541-5-smb devstack@keystone.service[98412]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 15:35:48.842896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:35:48.842896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: from cryptography.utils import int_from_bytes Aug 22 15:35:48.844021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:35:48.844021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: from cryptography.utils import int_from_bytes Aug 22 15:35:48.894866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 15:35:48.898815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 15:35:48.898815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] command line args: [] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 15:35:48.898815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 15:35:48.898815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ================================================================================ {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 15:35:48.898815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] admin_token = **** {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.898815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] config_dir = [] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.898815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.898815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] config_source = [] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.898815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] debug = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.899684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.899684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.899684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.899684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.899684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.899684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] list_limit = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.899684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] log_config_append = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.900462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.900462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] log_dir = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.900462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] log_file = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.900462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.900462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.900462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.900462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.900462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.901224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.901224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.901224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.901224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.901805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.901805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.902021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.902158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.902897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.903183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.903686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.903864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] publish_errors = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.904098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.904329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.904504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.904886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.905119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.905359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] standard_threads = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.905585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.905826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.905999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.906177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] use_journal = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.906353 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] use_json = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.906526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] use_stderr = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.906697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] use_syslog = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.906925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:48.907183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.907419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.907677 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.907929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.908164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.908409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.908675 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.908913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.909163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.909408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.909659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.909893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.910138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.910371 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.910614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.910969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.911220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.911475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.911732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.911977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.912214 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.912464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.912755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.913008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.913258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.913488 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.913719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.913949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.914183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.914432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.914683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.914913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.915141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.915394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.915637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.915872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.916123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.916384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.917015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.917015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.917351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.917351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.917695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.917864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.918027 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.918893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.919126 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.919363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.919597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.919855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.920055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.920305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.920689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.920868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.921069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.924989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.924989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.924989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.924989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.924989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.924989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.924989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.924989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.924989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.925728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.925728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.925728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.925728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.925728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.925728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.925728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.925728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.925728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.926833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.926833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.926833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.926833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.927283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.927283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.927524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.927652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.927804 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.928044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.928282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.928571 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.928817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.929061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.929298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.929589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.929828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.930065 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.930343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.930559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.930790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.931022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.931321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.931587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.931829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.932062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.932312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.932575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.932824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.933082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.933322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.933553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] auth.external = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.933809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.934107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.934335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.934569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] auth.password = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.934803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] auth.token = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.935043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.935277 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.935523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.935754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.936001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.936247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.936531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.936863 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] credential.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.937115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.937366 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.937615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.937851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.938096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.938331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.938584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.938838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.939075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.939327 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.939622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.939868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.940131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.940372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.940672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.940887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] federation.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.941125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.941374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.941619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.941873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.942094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.942356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.942593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.942831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.943084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.943326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.943565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.943801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.944049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.944296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.944562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.944786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.945088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.945502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.945651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.945900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.946152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.946384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.946618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.946850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.947096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.947343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.947590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.947846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.948093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.948365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.948637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.948879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.949112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.949349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.949580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.949815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.950057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.950296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.950544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.950778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.951024 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.951269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.951504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.951749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.951994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.952225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.952463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.952745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.952999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.953236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.953791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.954029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.954280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.954533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.954764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.954995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.955243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.955490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.955726 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.955960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.956195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.956425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.956690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.959567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.959567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.959567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.959567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.959567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.959567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.959567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.959567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.959567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.960648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.960648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.960648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.960648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.960648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.960648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.961257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.961257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.961257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.961575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.961731 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.961971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.962291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.962469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.962686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.962924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.963180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.963411 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.963661 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.963897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.964131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.964368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.964639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.965508 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.965852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.966062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.966275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] resource.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.966500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.966753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.966974 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.967227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.967479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.967716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.967964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.968199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.968420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.968691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] role.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.968929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] role.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.969161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.969906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.969906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.969906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.970234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.970353 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.970570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.970849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.971110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.971401 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.971677 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.971925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.972172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.972417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.972873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.973110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.973360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.973607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.973852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.974102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.974335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.974587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.974836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.975077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.975307 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.975539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.975770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.976019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.976274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.976541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.976783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.977019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.977402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.977582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] token.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.977817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.978063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.978298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.978553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.978797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.979036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.979279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.979528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.979771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.980008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.980247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.980481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.981310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.981560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.981790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.982034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.982329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.982591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.connection = **** {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.982834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.983081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.983320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.983562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.983802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.984086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.984323 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.984578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.984831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.985064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.985305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.985538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.985785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.991198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.991198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.991198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.991198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.991198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:48.991198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 15:35:49.017996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.022789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.022789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.027219 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.057943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.058205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.122574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.126645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:35:49.126645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: from cryptography.utils import int_from_bytes Aug 22 15:35:49.127350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:35:49.127350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: from cryptography.utils import int_from_bytes Aug 22 15:35:49.173761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.173989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.174547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 15:35:49.174744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 15:35:49.174940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] command line args: [] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 15:35:49.175224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 15:35:49.175404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ================================================================================ {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 15:35:49.175660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] admin_token = **** {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.175908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] config_dir = [] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.176095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.176276 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] config_source = [] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.176456 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] debug = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] list_limit = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] log_config_append = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] log_dir = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] log_file = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.179553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.180040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.180040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.180180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.180339 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.180611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.180848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.181083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.181317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.181564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.181814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.182091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.182601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.182782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] publish_errors = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.183014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.183244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.183421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.183717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.184454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.184819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] standard_threads = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.184989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.185233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.185410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.185586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] use_journal = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.185761 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] use_json = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.185936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] use_stderr = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.186111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] use_syslog = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.186342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:35:49.186601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.186841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.187104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.187344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.187594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.187835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.188088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.188325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.188598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.188855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.189112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.189359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.189603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.189856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.190101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.190348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.190584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.190838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.191093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.191341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.191579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.191834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.192111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.192365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.192643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.192875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.193110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.193344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.193581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.193842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.194090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.194323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.194556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.194806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.195054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.195292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.195541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.195778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.196015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.196256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.196488 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.196798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.197045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.197279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.197520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.197771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.198003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.198250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.198483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.198760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.198997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.199267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.199494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.199734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.199973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.200213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.200447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.200713 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.200945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.201198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.201439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.201674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.201907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.202169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.202407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.202641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.202879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.203117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.203388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.203626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.203876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.204124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.204363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.204622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.204861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.205111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.205352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.205591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.205837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.206077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.206317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.206555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.206791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.207028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.207391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.207559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.207871 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.208020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.208271 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.208543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.208772 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.209012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.209250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.209480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.209714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.209951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.210183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.210426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.210663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.210918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.211151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.211409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.211675 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.211923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.212164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] auth.external = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.212397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.212730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.212969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.213203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] auth.password = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.213436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] auth.token = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.213676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.213915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.214164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.214399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.214649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.214927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.215164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.215403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] credential.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.215653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.215905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.216154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.216397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.216665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.216905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.217176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.217436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.217671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.217930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] federation.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.223678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.224844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.225054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.225263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.225515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.225764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.226023 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.226321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.226549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.226790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.227028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.227261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.227499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.227733 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.227969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.228218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.228460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.228738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.228972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.229220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.229468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.229706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.229965 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.230215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.230450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.231212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.231447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.231686 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.231924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.232171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.232410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.232674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.232928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.233189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.233425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.233661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.233910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.234168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.234399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.234637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.234874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.235109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.235548 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.235884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.235884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.235884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.236838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.236838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.237040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.237180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.237419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.237660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.237904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.238142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.238394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.238651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.239666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.239666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.239666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.239666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.240111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.240111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.240344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.240557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.240799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.241049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.241303 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.241544 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.241804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.242036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.242296 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.242655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.242784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.242996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.243248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.243495 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.243732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.243973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.244217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] resource.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.244470 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.244760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.245003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.245255 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.245509 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.245749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.245999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.246298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.246586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.246772 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] role.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.247022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] role.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.247257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.247516 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.247768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.248018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.248269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.248540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.248804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.251968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.251968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.251968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.251968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.251968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.251968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.251968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.251968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.251968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.252980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.252980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.252980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.252980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.252980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.252980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.252980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.253724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.253724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.253724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.254064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.254064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.254326 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.254494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.254737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.254981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.255215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.255456 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] token.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.255697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.255950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.256190 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.256450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.256733 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.256979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.257228 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.257515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.257783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.258000 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.258197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.258442 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.258694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.258946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.259180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.259426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.259740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.260004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.connection = **** {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.260252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.260503 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.260772 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.261015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.261253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.261492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.262229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.262486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.262733 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.262971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.263218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.263502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.263893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.264146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.264412 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.264680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.264930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.265173 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:35:49.265348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 15:35:49.295130 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.295345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.295573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.305093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.325169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.325404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.349355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.349586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.349814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.350078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.350341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.350566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.365588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.381394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.381573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.381765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.381987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.382205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.382422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.382639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.397918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.402964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.403203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.410829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.411128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.411359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.411580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.411797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.412021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.412239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.429814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.430027 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 15:35:49.443611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.443611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 15:35:49.443611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.443611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.443611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.443611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.443611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.444163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.444163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.444163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.449845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.452907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.453203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.453495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.453785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.454076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.454342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.454617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.454895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.455300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.455583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.455859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.465364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.465608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.465831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.466049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.466265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.466477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.479209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.480430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.481256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.481380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.481466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.481645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.481770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.481988 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.482202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.482422 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.486646 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.487887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.487887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.493487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.493624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.493877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.498065 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.498377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.498670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.498958 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.499248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.499531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.499809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.500087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.517911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.518207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.522338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.525812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.526132 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.531326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.534775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.538690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.539049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.539304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.539598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.539885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.540192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.562481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.567241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.567241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.567241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.571122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.572759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.573046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.576656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.576970 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.577273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.577586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.577875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.586313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.586546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.586772 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.586993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.587208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.587422 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.587636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:35:49.589413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.589719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.590540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.597850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.597850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.597850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.597850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.606773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.606978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 15:35:49.607329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.607529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 15:35:49.607804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.608074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.608155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.608340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.608627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.611225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.614172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.615627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.617140 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.617432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.617738 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.618189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.618476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.618749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.619036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.624265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.625752 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.625990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.628682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.630302 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.630443 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.630584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.630704 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.630819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.630935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.630935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.630935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.630935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.630935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.631474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.631474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.631682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.631861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.637614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.637958 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.638245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.645198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=98422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.645492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.645778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.646057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.646333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.646623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.646904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.647174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.647466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.647752 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.648049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.648301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.648607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.648873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.655440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.657084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.657464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.662199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.662486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.662769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.669899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.670197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.674633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.674956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.675251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.675536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.675816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.676118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.676391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.676692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.688579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb787d99c0 pid: 98422 (default app) Aug 22 15:35:49.692552 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.692848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.693779 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a219e-68e5-4fe9-96ca-9f537f42705f None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:35:49.694178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a219e-68e5-4fe9-96ca-9f537f42705f None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:35:49.694557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a219e-68e5-4fe9-96ca-9f537f42705f None None] PATH_INFO: `/v3` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:35:49.696730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.699865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.700171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.700973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon Aug 22 15:35:49 2022] GET /identity/v3/ => generated 255 bytes in 12 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:35:49.704565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.707921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.711089 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.711399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.711691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.711985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.712263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.712561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.729057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.729365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.729638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.729921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.737348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.738903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.739178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.743325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.743622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.743935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.744220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.744498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.755831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.756128 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.756420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.756721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.757010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.757290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.757575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.773310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.776237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.779730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.781557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.782819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.783107 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.783410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.789876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.791485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.795398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.795398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.795664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.796336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.810526 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.810526 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.810526 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.812816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=98421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:35:49.812816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.812816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.812816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.813277 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.813277 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.813583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.814439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.814439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.814439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.815080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.815080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.822986 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.822986 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:35:49.860433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb787d99c0 pid: 98421 (default app) Aug 22 15:35:57.618764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c15f53-4294-424b-9d65-a713c9ab84cb None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:35:57.619417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c15f53-4294-424b-9d65-a713c9ab84cb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:35:57.619417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c15f53-4294-424b-9d65-a713c9ab84cb None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:35:57.620946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:35:57.630649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:35:57.631215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:35:57.631215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:35:57.703998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: INFO dbcounter [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] Registered counter for database keystone Aug 22 15:35:57.726693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG oslo_db.sqlalchemy.engines [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:35:57.733630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writer thread running {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:35:57.925347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG passlib.handlers.bcrypt [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98421) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 15:35:57.925347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG passlib.handlers.bcrypt [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98421) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 15:35:57.981974 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:35:57.983641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:35:58.130057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1/3] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:35:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 15:35:58.595039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c15f53-4294-424b-9d65-a713c9ab84cb None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:35:58.670185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: INFO dbcounter [None req-00c15f53-4294-424b-9d65-a713c9ab84cb None None] Registered counter for database keystone Aug 22 15:35:58.690564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG oslo_db.sqlalchemy.engines [None req-00c15f53-4294-424b-9d65-a713c9ab84cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:35:58.697029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writer thread running {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:35:58.817919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c15f53-4294-424b-9d65-a713c9ab84cb None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:35:58.822189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867e461-ca54-42f3-8fff-896524401296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:35:58.822825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867e461-ca54-42f3-8fff-896524401296 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:35:58.823102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867e461-ca54-42f3-8fff-896524401296 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:35:58.823373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867e461-ca54-42f3-8fff-896524401296 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:35:58.832243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867e461-ca54-42f3-8fff-896524401296 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:35:58.884114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4867e461-ca54-42f3-8fff-896524401296 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 15:35:58.884348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867e461-ca54-42f3-8fff-896524401296 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:35:58.897904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Aug 22 15:35:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 15:35:58.904647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:35:58.920823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375c505-87b3-42e0-98e4-96b8cfb957e5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:35:58.926637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcafb54-4bc6-40fd-8bd3-f205fd810019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:35:58.927840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcafb54-4bc6-40fd-8bd3-f205fd810019 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:35:58.928126 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcafb54-4bc6-40fd-8bd3-f205fd810019 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:35:58.928401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcafb54-4bc6-40fd-8bd3-f205fd810019 admin admin] PATH_INFO: `/v3/projects/01b431c789654fc6addb5ceef4aa5682` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:35:58.929917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcafb54-4bc6-40fd-8bd3-f205fd810019 admin admin] RBAC: Authorizing `identity:get_project(project_id=01b431c789654fc6addb5ceef4aa5682)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:35:58.982829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ebcafb54-4bc6-40fd-8bd3-f205fd810019 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 15:35:58.983174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcafb54-4bc6-40fd-8bd3-f205fd810019 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:35:58.988122 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 2/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Aug 22 15:35:58 2022] GET /identity/v3/projects/01b431c789654fc6addb5ceef4aa5682 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:00.899872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c942f-78b6-496a-8ee2-9103b40ac77a None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:00.900407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c942f-78b6-496a-8ee2-9103b40ac77a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:00.900407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c942f-78b6-496a-8ee2-9103b40ac77a None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:00.905167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 4/6] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:00.911947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e492f-3aae-44e2-a8df-7a0989033c97 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:00.912502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e492f-3aae-44e2-a8df-7a0989033c97 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:00.912502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e492f-3aae-44e2-a8df-7a0989033c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:00.933653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-392e492f-3aae-44e2-a8df-7a0989033c97 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:00.935215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-392e492f-3aae-44e2-a8df-7a0989033c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:00.943309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 22 15:36:01.226076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c942f-78b6-496a-8ee2-9103b40ac77a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:01.238363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c942f-78b6-496a-8ee2-9103b40ac77a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:01.242598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2d57b-73ba-4665-87ec-740db73836ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:01.243204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d57b-73ba-4665-87ec-740db73836ff admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:01.243480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d57b-73ba-4665-87ec-740db73836ff admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:01.243750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2d57b-73ba-4665-87ec-740db73836ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:01.252069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2d57b-73ba-4665-87ec-740db73836ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:01.254612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2d57b-73ba-4665-87ec-740db73836ff admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:01.264494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Aug 22 15:36:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 15:36:01.270344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e492f-3aae-44e2-a8df-7a0989033c97 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:01.283018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e492f-3aae-44e2-a8df-7a0989033c97 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:01.289197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703d24b-70a9-4470-ab85-35e235069086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:01.290104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703d24b-70a9-4470-ab85-35e235069086 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:01.290527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703d24b-70a9-4470-ab85-35e235069086 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:01.290939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703d24b-70a9-4470-ab85-35e235069086 admin admin] PATH_INFO: `/v3/users/b59293d8226b4fba854dac5ea94dd380` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:01.292946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703d24b-70a9-4470-ab85-35e235069086 admin admin] RBAC: Authorizing `identity:get_user(user_id=b59293d8226b4fba854dac5ea94dd380)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:01.295871 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703d24b-70a9-4470-ab85-35e235069086 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:01.298591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 4/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Aug 22 15:36:01 2022] GET /identity/v3/users/b59293d8226b4fba854dac5ea94dd380 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:03.362103 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bc1e8-1415-45b6-a81f-3174617999c0 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:03.362695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bc1e8-1415-45b6-a81f-3174617999c0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:03.362695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111bc1e8-1415-45b6-a81f-3174617999c0 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:03.363990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:03.369572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb080d59-6c81-4cb5-8584-750cf0f25767 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:03.370076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb080d59-6c81-4cb5-8584-750cf0f25767 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:03.370230 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb080d59-6c81-4cb5-8584-750cf0f25767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:03.380204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fcf0b-2571-423e-b92a-51ac7a1614be None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:03.380495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fcf0b-2571-423e-b92a-51ac7a1614be None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:03.380817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fcf0b-2571-423e-b92a-51ac7a1614be None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:03.382188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 7/11] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:36:03.387694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd326630-1d1c-4b09-8240-a20e549db06b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:03.387979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd326630-1d1c-4b09-8240-a20e549db06b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:03.388258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd326630-1d1c-4b09-8240-a20e549db06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:03.391130 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-fb080d59-6c81-4cb5-8584-750cf0f25767 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:03.392342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fb080d59-6c81-4cb5-8584-750cf0f25767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:03.432708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG passlib.handlers.bcrypt [None req-fd326630-1d1c-4b09-8240-a20e549db06b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98422) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 15:36:03.433123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG passlib.handlers.bcrypt [None req-fd326630-1d1c-4b09-8240-a20e549db06b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98422) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 15:36:03.479031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-fd326630-1d1c-4b09-8240-a20e549db06b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:03.480830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 5/12] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:03.481228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fd326630-1d1c-4b09-8240-a20e549db06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:03.586403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:03.747736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb080d59-6c81-4cb5-8584-750cf0f25767 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:03.772356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:03.861044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd326630-1d1c-4b09-8240-a20e549db06b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:03.861658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb080d59-6c81-4cb5-8584-750cf0f25767 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:03.898029 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018821fc-9f69-48a6-9771-f408b1f1af10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:03.898657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018821fc-9f69-48a6-9771-f408b1f1af10 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:03.898939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018821fc-9f69-48a6-9771-f408b1f1af10 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:03.899213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018821fc-9f69-48a6-9771-f408b1f1af10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:03.971282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018821fc-9f69-48a6-9771-f408b1f1af10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:03.972822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018821fc-9f69-48a6-9771-f408b1f1af10 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:03.977014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd326630-1d1c-4b09-8240-a20e549db06b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:03.981026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:03.997457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:04.018589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02457b45-7b68-4a8e-8045-e7dd3483b9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:04.019763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02457b45-7b68-4a8e-8045-e7dd3483b9c1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:04.020047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02457b45-7b68-4a8e-8045-e7dd3483b9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:04.020345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02457b45-7b68-4a8e-8045-e7dd3483b9c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:04.034191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02457b45-7b68-4a8e-8045-e7dd3483b9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-02457b45-7b68-4a8e-8045-e7dd3483b9c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:04.044064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:04.045298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:04.046331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 9/14] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:04.052130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02457b45-7b68-4a8e-8045-e7dd3483b9c1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:04.081997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 6/15] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:04.087536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018821fc-9f69-48a6-9771-f408b1f1af10 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:04.158909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02457b45-7b68-4a8e-8045-e7dd3483b9c1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:04.194580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018821fc-9f69-48a6-9771-f408b1f1af10 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:04.197632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951a7b6-1365-4ad8-8bc6-0e495b3fa24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:04.198321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a7b6-1365-4ad8-8bc6-0e495b3fa24f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:04.198723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a7b6-1365-4ad8-8bc6-0e495b3fa24f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:04.199621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951a7b6-1365-4ad8-8bc6-0e495b3fa24f None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:04.200433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951a7b6-1365-4ad8-8bc6-0e495b3fa24f None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:04.200877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951a7b6-1365-4ad8-8bc6-0e495b3fa24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:04.202460 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951a7b6-1365-4ad8-8bc6-0e495b3fa24f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:04.215532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 10/16] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:04.222252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951a7b6-1365-4ad8-8bc6-0e495b3fa24f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:04.234207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:04.248204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7811be-6acc-4f8f-9011-ee529ce82fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:04.248890 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7811be-6acc-4f8f-9011-ee529ce82fef None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:04.249168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7811be-6acc-4f8f-9011-ee529ce82fef None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:04.249443 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7811be-6acc-4f8f-9011-ee529ce82fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:04.252968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:04.260955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7811be-6acc-4f8f-9011-ee529ce82fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:04.263026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7811be-6acc-4f8f-9011-ee529ce82fef None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-3e7811be-6acc-4f8f-9011-ee529ce82fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:36:04.282542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:04.283638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:36:04.290062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:36:04.290062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:36:04.290062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:04.290062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 7/17] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:36:04.290062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7811be-6acc-4f8f-9011-ee529ce82fef None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:04.333889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951a7b6-1365-4ad8-8bc6-0e495b3fa24f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:04.375939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6efa6f-78e9-406f-8de5-1ba15f9440c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:04.376749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6efa6f-78e9-406f-8de5-1ba15f9440c3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:04.376992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6efa6f-78e9-406f-8de5-1ba15f9440c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:04.377263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6efa6f-78e9-406f-8de5-1ba15f9440c3 None admin] PATH_INFO: `/v3/users/b59293d8226b4fba854dac5ea94dd380` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:04.378756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6efa6f-78e9-406f-8de5-1ba15f9440c3 None admin] RBAC: Authorizing `identity:get_user(user_id=b59293d8226b4fba854dac5ea94dd380)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:04.380417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6efa6f-78e9-406f-8de5-1ba15f9440c3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:04.382235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 11/18] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:04 2022] GET /identity/v3/users/b59293d8226b4fba854dac5ea94dd380 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:04.388331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6efa6f-78e9-406f-8de5-1ba15f9440c3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:04.413692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7811be-6acc-4f8f-9011-ee529ce82fef None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:04.463189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c41fef-bebd-474d-a563-f6d5bfe63c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:04.463824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c41fef-bebd-474d-a563-f6d5bfe63c4e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:04.464099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c41fef-bebd-474d-a563-f6d5bfe63c4e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:04.464369 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c41fef-bebd-474d-a563-f6d5bfe63c4e None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:04.465662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c41fef-bebd-474d-a563-f6d5bfe63c4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:04.465966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c41fef-bebd-474d-a563-f6d5bfe63c4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:04.467389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c41fef-bebd-474d-a563-f6d5bfe63c4e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:04.485154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 8/19] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:04.485710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:04.493765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6efa6f-78e9-406f-8de5-1ba15f9440c3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:04.533888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fcd59-5a76-4f32-b8db-8de7ca023444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:04.534512 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fcd59-5a76-4f32-b8db-8de7ca023444 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:04.534793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fcd59-5a76-4f32-b8db-8de7ca023444 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:04.535061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fcd59-5a76-4f32-b8db-8de7ca023444 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:04.536325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fcd59-5a76-4f32-b8db-8de7ca023444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:04.537900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fcd59-5a76-4f32-b8db-8de7ca023444 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:04.539650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 12/20] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:04.546245 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c41fef-bebd-474d-a563-f6d5bfe63c4e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:04.587806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:04.672461 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c41fef-bebd-474d-a563-f6d5bfe63c4e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:04.718291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928d8f1-8f64-4acb-a701-0728f92bf671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:04.719030 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928d8f1-8f64-4acb-a701-0728f92bf671 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:04.719402 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928d8f1-8f64-4acb-a701-0728f92bf671 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:04.719684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928d8f1-8f64-4acb-a701-0728f92bf671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:04.720468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928d8f1-8f64-4acb-a701-0728f92bf671 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.domain.id=default, user.id=b59293d8226b4fba854dac5ea94dd380) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:04.720878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928d8f1-8f64-4acb-a701-0728f92bf671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:04.722391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928d8f1-8f64-4acb-a701-0728f92bf671 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:04.730792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 9/21] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Aug 22 15:36:04 2022] GET /identity/v3/role_assignments?user.id=b59293d8226b4fba854dac5ea94dd380&scope.domain.id=default&role.id=eeb6551eeb934053866fc821b511b5dd => generated 233 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:06.837941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859fe9c-9908-4d34-8019-ad76c43aed47 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:06.838470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859fe9c-9908-4d34-8019-ad76c43aed47 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:06.838744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859fe9c-9908-4d34-8019-ad76c43aed47 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:06.841391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 13/22] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:06.847364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33ab3-e8d8-4160-ae0e-efecc086c53e None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:06.847836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33ab3-e8d8-4160-ae0e-efecc086c53e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:06.848154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33ab3-e8d8-4160-ae0e-efecc086c53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:06.879991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-7eb33ab3-e8d8-4160-ae0e-efecc086c53e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:06.881701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7eb33ab3-e8d8-4160-ae0e-efecc086c53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:06.972272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 10/23] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:07.004641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec97b72-fe90-4a3e-80a9-09f4a07c80bd None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:07.004948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec97b72-fe90-4a3e-80a9-09f4a07c80bd None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:07.005189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec97b72-fe90-4a3e-80a9-09f4a07c80bd None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:07.006548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 14/24] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:07.012600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7adb7-ad70-474f-8436-979d13c32c1f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:07.012887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7adb7-ad70-474f-8436-979d13c32c1f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:07.013158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7adb7-ad70-474f-8436-979d13c32c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:07.039202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4ac7adb7-ad70-474f-8436-979d13c32c1f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:07.040527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4ac7adb7-ad70-474f-8436-979d13c32c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:07.076766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:07.134589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 11/25] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:07.441846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec97b72-fe90-4a3e-80a9-09f4a07c80bd None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:07.587933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec97b72-fe90-4a3e-80a9-09f4a07c80bd None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:07.592473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7adb7-ad70-474f-8436-979d13c32c1f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:07.660027 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a672a-22bf-4c1b-84f2-0cb0c8def324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:07.660925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a672a-22bf-4c1b-84f2-0cb0c8def324 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:07.661466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a672a-22bf-4c1b-84f2-0cb0c8def324 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:07.661881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a672a-22bf-4c1b-84f2-0cb0c8def324 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:07.662704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a672a-22bf-4c1b-84f2-0cb0c8def324 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:07.664354 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a672a-22bf-4c1b-84f2-0cb0c8def324 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:07.757315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7adb7-ad70-474f-8436-979d13c32c1f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:07.800925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983631ac-5e74-42e8-a5d6-6f2ec7b11e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:07.801638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983631ac-5e74-42e8-a5d6-6f2ec7b11e50 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:07.801922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983631ac-5e74-42e8-a5d6-6f2ec7b11e50 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:07.802194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983631ac-5e74-42e8-a5d6-6f2ec7b11e50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:07.815699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983631ac-5e74-42e8-a5d6-6f2ec7b11e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:07.817310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983631ac-5e74-42e8-a5d6-6f2ec7b11e50 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-983631ac-5e74-42e8-a5d6-6f2ec7b11e50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:36:07.835315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:07.842179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:36:07.844095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:36:07.844095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:36:07.844095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:07.844095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 12/26] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:07.844095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781311b-dcc8-4446-a905-1edcd192609a None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:07.844095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781311b-dcc8-4446-a905-1edcd192609a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:07.844095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781311b-dcc8-4446-a905-1edcd192609a None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:07.844095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:07.844095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074657-ef58-4520-b1be-b86e9da90af3 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:07.845499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074657-ef58-4520-b1be-b86e9da90af3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:07.845499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074657-ef58-4520-b1be-b86e9da90af3 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:07.845499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 14/28] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:07.846225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3c277-5d2d-4da9-9461-cd0b6c874607 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:07.846225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3c277-5d2d-4da9-9461-cd0b6c874607 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:07.846225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3c277-5d2d-4da9-9461-cd0b6c874607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:07.871676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-61c3c277-5d2d-4da9-9461-cd0b6c874607 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:07.873073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-61c3c277-5d2d-4da9-9461-cd0b6c874607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:07.877317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:07.958453 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 15/29] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:07.959216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3c277-5d2d-4da9-9461-cd0b6c874607 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:07.968594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 15/30] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Aug 22 15:36:07 2022] POST /identity/v3/roles => generated 219 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:07.971508 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be329a5-ec19-4231-850b-9119b228119a None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:07.971806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be329a5-ec19-4231-850b-9119b228119a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:07.972086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be329a5-ec19-4231-850b-9119b228119a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:08.013969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3be329a5-ec19-4231-850b-9119b228119a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:08.015904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3be329a5-ec19-4231-850b-9119b228119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:08.061250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:08.104874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3c277-5d2d-4da9-9461-cd0b6c874607 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:08.160728 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb7eab-04f1-45c3-860b-2036dbdbce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:08.161804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb7eab-04f1-45c3-860b-2036dbdbce97 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:08.162516 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb7eab-04f1-45c3-860b-2036dbdbce97 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:08.163148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb7eab-04f1-45c3-860b-2036dbdbce97 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:08.165245 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb7eab-04f1-45c3-860b-2036dbdbce97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:08.166522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb7eab-04f1-45c3-860b-2036dbdbce97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:08.170687 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb7eab-04f1-45c3-860b-2036dbdbce97 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:08.199645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:08.207384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 16/31] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:08.212633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 16/32] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:08.213803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be329a5-ec19-4231-850b-9119b228119a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:08.330799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a84015-b209-4f1a-abc2-9375ad84f3b2 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:08.331466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a84015-b209-4f1a-abc2-9375ad84f3b2 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:08.332021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a84015-b209-4f1a-abc2-9375ad84f3b2 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:08.334112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 17/33] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:08.339212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8677c5-172c-4ea9-a9db-0827511f9ba9 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:08.340018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8677c5-172c-4ea9-a9db-0827511f9ba9 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:08.340299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8677c5-172c-4ea9-a9db-0827511f9ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:08.371771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be329a5-ec19-4231-850b-9119b228119a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:08.377666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0f8677c5-172c-4ea9-a9db-0827511f9ba9 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:08.378889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0f8677c5-172c-4ea9-a9db-0827511f9ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:08.421658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634082d1-332a-4ce8-81ef-e6aa0a4148a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:08.422927 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634082d1-332a-4ce8-81ef-e6aa0a4148a0 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:08.423861 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634082d1-332a-4ce8-81ef-e6aa0a4148a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:08.424566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634082d1-332a-4ce8-81ef-e6aa0a4148a0 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:08.425736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634082d1-332a-4ce8-81ef-e6aa0a4148a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:08.428139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634082d1-332a-4ce8-81ef-e6aa0a4148a0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:08.490792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 18/34] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:08.492063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8677c5-172c-4ea9-a9db-0827511f9ba9 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:08.598928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 17/35] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:36:08 2022] POST /identity/v3/projects => generated 301 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:08.600121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634082d1-332a-4ce8-81ef-e6aa0a4148a0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:08.607042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8677c5-172c-4ea9-a9db-0827511f9ba9 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:08.611838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:08.645203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:08.652638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2458078-5a0f-49e1-8fd9-b2a25de97f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:08.653367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2458078-5a0f-49e1-8fd9-b2a25de97f9c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:08.653717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2458078-5a0f-49e1-8fd9-b2a25de97f9c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:08.653996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2458078-5a0f-49e1-8fd9-b2a25de97f9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:08.667500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2458078-5a0f-49e1-8fd9-b2a25de97f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-d2458078-5a0f-49e1-8fd9-b2a25de97f9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:08.675070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:08.676008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:08.676924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 19/36] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:08.688463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2458078-5a0f-49e1-8fd9-b2a25de97f9c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:08.829477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634082d1-332a-4ce8-81ef-e6aa0a4148a0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:08.859623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2458078-5a0f-49e1-8fd9-b2a25de97f9c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:08.873527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a077b-3f0a-4ed6-863e-48e59924eb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:08.874300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a077b-3f0a-4ed6-863e-48e59924eb30 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:08.874588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a077b-3f0a-4ed6-863e-48e59924eb30 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:08.874866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a077b-3f0a-4ed6-863e-48e59924eb30 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:08.876249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a077b-3f0a-4ed6-863e-48e59924eb30 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:08.877036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a077b-3f0a-4ed6-863e-48e59924eb30 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:08.923696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328b465-446c-450f-8a59-ffaf9d8f1a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:08.924711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328b465-446c-450f-8a59-ffaf9d8f1a3b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:08.925061 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328b465-446c-450f-8a59-ffaf9d8f1a3b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:08.925379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328b465-446c-450f-8a59-ffaf9d8f1a3b None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:08.926170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328b465-446c-450f-8a59-ffaf9d8f1a3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:08.926541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328b465-446c-450f-8a59-ffaf9d8f1a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:08.927993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328b465-446c-450f-8a59-ffaf9d8f1a3b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:08.941387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 20/37] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:08.943064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c05cb-5f90-438b-8d86-5cbcb224195b None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:08.943264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c05cb-5f90-438b-8d86-5cbcb224195b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:08.943553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c05cb-5f90-438b-8d86-5cbcb224195b None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:08.945011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 21/38] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:08.945600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c05cb-5f90-438b-8d86-5cbcb224195b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:08.963026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 18/39] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Aug 22 15:36:08 2022] POST /identity/v3/roles => generated 225 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:08.969683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a077b-3f0a-4ed6-863e-48e59924eb30 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:09.014045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:09.065147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:09.092174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c05cb-5f90-438b-8d86-5cbcb224195b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:09.122279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a077b-3f0a-4ed6-863e-48e59924eb30 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:09.145888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede0e35-5871-4cd1-a931-eb46308d0782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:09.146777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede0e35-5871-4cd1-a931-eb46308d0782 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:09.147060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede0e35-5871-4cd1-a931-eb46308d0782 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:09.147370 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede0e35-5871-4cd1-a931-eb46308d0782 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:09.148056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede0e35-5871-4cd1-a931-eb46308d0782 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:09.149503 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede0e35-5871-4cd1-a931-eb46308d0782 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:09.176787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660f785-77fc-4f01-a135-cd11528739e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:09.177449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f785-77fc-4f01-a135-cd11528739e5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:09.177732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f785-77fc-4f01-a135-cd11528739e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:09.178006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f785-77fc-4f01-a135-cd11528739e5 None admin] PATH_INFO: `/v3/users/b59293d8226b4fba854dac5ea94dd380` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:09.179185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660f785-77fc-4f01-a135-cd11528739e5 None admin] RBAC: Authorizing `identity:get_user(user_id=b59293d8226b4fba854dac5ea94dd380)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:09.180871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660f785-77fc-4f01-a135-cd11528739e5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:09.182629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 19/40] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:08 2022] GET /identity/v3/users/b59293d8226b4fba854dac5ea94dd380 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:09.184393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df93e-6e8f-4b0f-ac1d-e8bac6c8d80e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:09.184782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df93e-6e8f-4b0f-ac1d-e8bac6c8d80e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:09.185062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df93e-6e8f-4b0f-ac1d-e8bac6c8d80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:09.205533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b88df93e-6e8f-4b0f-ac1d-e8bac6c8d80e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:09.206764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b88df93e-6e8f-4b0f-ac1d-e8bac6c8d80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:09.285098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 20/41] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:09.286385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88df93e-6e8f-4b0f-ac1d-e8bac6c8d80e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:09.343623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Aug 22 15:36:08 2022] POST /identity/v3/roles => generated 223 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:09.368199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:09.418464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88df93e-6e8f-4b0f-ac1d-e8bac6c8d80e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:09.462119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88659eb-bd92-4442-99f7-ec719fed7ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:09.462793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88659eb-bd92-4442-99f7-ec719fed7ec0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:09.463073 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88659eb-bd92-4442-99f7-ec719fed7ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:09.463346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88659eb-bd92-4442-99f7-ec719fed7ec0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:09.465244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88659eb-bd92-4442-99f7-ec719fed7ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:09.466855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88659eb-bd92-4442-99f7-ec719fed7ec0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:09.468851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:09.475117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede0e35-5871-4cd1-a931-eb46308d0782 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:09.587840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88659eb-bd92-4442-99f7-ec719fed7ec0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:09.704281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88659eb-bd92-4442-99f7-ec719fed7ec0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:09.713919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede0e35-5871-4cd1-a931-eb46308d0782 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:09.728743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:09.739792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:09.748704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0dd10-74f9-4d1c-a833-8d6d1dec5e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:09.749463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0dd10-74f9-4d1c-a833-8d6d1dec5e82 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:09.749751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0dd10-74f9-4d1c-a833-8d6d1dec5e82 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:09.753793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0dd10-74f9-4d1c-a833-8d6d1dec5e82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:09.753793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0dd10-74f9-4d1c-a833-8d6d1dec5e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:09.753793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0dd10-74f9-4d1c-a833-8d6d1dec5e82 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:09.754456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 22/44] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:09.755265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac7e9-c5e7-42a7-889e-f6f158df85fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:09.756631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac7e9-c5e7-42a7-889e-f6f158df85fe None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:09.757189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac7e9-c5e7-42a7-889e-f6f158df85fe None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:09.757679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac7e9-c5e7-42a7-889e-f6f158df85fe None admin] PATH_INFO: `/v3/domains/default/users/b59293d8226b4fba854dac5ea94dd380/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:09.761598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ac7e9-c5e7-42a7-889e-f6f158df85fe None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b59293d8226b4fba854dac5ea94dd380, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:09.763025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0dd10-74f9-4d1c-a833-8d6d1dec5e82 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:09.763499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ac7e9-c5e7-42a7-889e-f6f158df85fe None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:09.841855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 23/45] 10.222.0.18 () {58 vars in 1361 bytes} [Mon Aug 22 15:36:09 2022] PUT /identity/v3/domains/default/users/b59293d8226b4fba854dac5ea94dd380/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:36:09.885342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0dd10-74f9-4d1c-a833-8d6d1dec5e82 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:09.931753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bac4c-6a48-45ab-b03a-08f82d945d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:09.932414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bac4c-6a48-45ab-b03a-08f82d945d7d None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:09.932730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bac4c-6a48-45ab-b03a-08f82d945d7d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:09.933009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bac4c-6a48-45ab-b03a-08f82d945d7d None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:09.934981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bac4c-6a48-45ab-b03a-08f82d945d7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:09.936674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bac4c-6a48-45ab-b03a-08f82d945d7d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:10.038753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:36:09 2022] POST /identity/v3/projects => generated 312 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:36:11.935903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e71ec6-ba68-4418-98c5-96a831c629a3 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:11.936424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e71ec6-ba68-4418-98c5-96a831c629a3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:11.936534 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e71ec6-ba68-4418-98c5-96a831c629a3 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:11.937847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:11.944215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c739b30-0ced-4004-91e6-e164c6eb1435 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:11.944758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c739b30-0ced-4004-91e6-e164c6eb1435 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:11.944758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c739b30-0ced-4004-91e6-e164c6eb1435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:11.963886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3c739b30-0ced-4004-91e6-e164c6eb1435 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:11.966071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3c739b30-0ced-4004-91e6-e164c6eb1435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:12.023525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:12.045640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:12.141563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b7816-0883-4445-ae1c-84e9c85c52d3 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:12.141889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b7816-0883-4445-ae1c-84e9c85c52d3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:12.142210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b7816-0883-4445-ae1c-84e9c85c52d3 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:12.143726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 25/49] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:12.149853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538ae11-6e3d-46af-b5c1-0170d0397da9 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:12.150156 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538ae11-6e3d-46af-b5c1-0170d0397da9 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:12.150435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538ae11-6e3d-46af-b5c1-0170d0397da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:12.169052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e538ae11-6e3d-46af-b5c1-0170d0397da9 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:12.170316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e538ae11-6e3d-46af-b5c1-0170d0397da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:12.244211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 25/50] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:12.329662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b7816-0883-4445-ae1c-84e9c85c52d3 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:12.441704 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b7816-0883-4445-ae1c-84e9c85c52d3 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:12.476228 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91520-6173-4b37-9133-06eb4d219b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:12.476897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91520-6173-4b37-9133-06eb4d219b3b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:12.477176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91520-6173-4b37-9133-06eb4d219b3b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:12.477447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91520-6173-4b37-9133-06eb4d219b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:12.489539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c91520-6173-4b37-9133-06eb4d219b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-96c91520-6173-4b37-9133-06eb4d219b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:12.494398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:12.496116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:12.497232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:36:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:12.502409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538ae11-6e3d-46af-b5c1-0170d0397da9 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:12.513938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91520-6173-4b37-9133-06eb4d219b3b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:12.550705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:12.626337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91520-6173-4b37-9133-06eb4d219b3b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:12.627287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538ae11-6e3d-46af-b5c1-0170d0397da9 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:12.639718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:12.663524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fb0e9-4aee-4275-b22e-399365c40962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:12.664346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fb0e9-4aee-4275-b22e-399365c40962 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:12.664730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fb0e9-4aee-4275-b22e-399365c40962 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:12.665138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fb0e9-4aee-4275-b22e-399365c40962 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:12.666535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fb0e9-4aee-4275-b22e-399365c40962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:12.668829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fb0e9-4aee-4275-b22e-399365c40962 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:12.670756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 27/52] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:12.671010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bb084-10a1-4059-afc6-a2fa6419c1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:12.671806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bb084-10a1-4059-afc6-a2fa6419c1ec None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:12.672135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bb084-10a1-4059-afc6-a2fa6419c1ec None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:12.672462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bb084-10a1-4059-afc6-a2fa6419c1ec None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:12.673702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bb084-10a1-4059-afc6-a2fa6419c1ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:12.674055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bb084-10a1-4059-afc6-a2fa6419c1ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:12.675918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bb084-10a1-4059-afc6-a2fa6419c1ec None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:12.677664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fb0e9-4aee-4275-b22e-399365c40962 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:12.688670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:12.694170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bb084-10a1-4059-afc6-a2fa6419c1ec None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:12.806794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:12.810060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fb0e9-4aee-4275-b22e-399365c40962 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:12.821493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bb084-10a1-4059-afc6-a2fa6419c1ec None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:12.848584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe5bf0-b234-4a60-bf3c-16c507868d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:12.849272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe5bf0-b234-4a60-bf3c-16c507868d52 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:12.849554 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe5bf0-b234-4a60-bf3c-16c507868d52 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:12.849832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe5bf0-b234-4a60-bf3c-16c507868d52 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:12.850489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe5bf0-b234-4a60-bf3c-16c507868d52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:12.851980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe5bf0-b234-4a60-bf3c-16c507868d52 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:12.864449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be930f-64f7-4024-ba98-adab543b549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:12.865485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be930f-64f7-4024-ba98-adab543b549b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:12.865957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be930f-64f7-4024-ba98-adab543b549b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:12.866389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be930f-64f7-4024-ba98-adab543b549b None admin] PATH_INFO: `/v3/users/b59293d8226b4fba854dac5ea94dd380` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:12.868205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be930f-64f7-4024-ba98-adab543b549b None admin] RBAC: Authorizing `identity:get_user(user_id=b59293d8226b4fba854dac5ea94dd380)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:12.869709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be930f-64f7-4024-ba98-adab543b549b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:12.871382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 27/54] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:12 2022] GET /identity/v3/users/b59293d8226b4fba854dac5ea94dd380 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:12.877158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be930f-64f7-4024-ba98-adab543b549b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:12.922540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:12.953240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 28/55] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Aug 22 15:36:12 2022] POST /identity/v3/projects => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:36:12.990684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be930f-64f7-4024-ba98-adab543b549b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:13.048952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231470fc-058a-4448-92e9-7f60a2523ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:13.049884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231470fc-058a-4448-92e9-7f60a2523ed4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:13.050339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231470fc-058a-4448-92e9-7f60a2523ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:13.050708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231470fc-058a-4448-92e9-7f60a2523ed4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:13.051975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231470fc-058a-4448-92e9-7f60a2523ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:13.053545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231470fc-058a-4448-92e9-7f60a2523ed4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:13.055211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 28/56] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:13.061856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe5bf0-b234-4a60-bf3c-16c507868d52 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:13.181064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe5bf0-b234-4a60-bf3c-16c507868d52 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:13.215982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4559fe-0798-4377-bac7-ff238c7eb3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:13.216627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4559fe-0798-4377-bac7-ff238c7eb3d8 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:13.216914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4559fe-0798-4377-bac7-ff238c7eb3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:13.217191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4559fe-0798-4377-bac7-ff238c7eb3d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:13.217917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4559fe-0798-4377-bac7-ff238c7eb3d8 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.domain.id=default, user.id=b59293d8226b4fba854dac5ea94dd380) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:13.218229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4559fe-0798-4377-bac7-ff238c7eb3d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:13.219713 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4559fe-0798-4377-bac7-ff238c7eb3d8 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:13.226235 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 29/57] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Aug 22 15:36:13 2022] GET /identity/v3/role_assignments?user.id=b59293d8226b4fba854dac5ea94dd380&scope.domain.id=default&role.id=eeb6551eeb934053866fc821b511b5dd => generated 530 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:14.893641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6301770-8eb1-4610-982b-3b5a7ed12d9a None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:14.894174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6301770-8eb1-4610-982b-3b5a7ed12d9a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:14.894174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6301770-8eb1-4610-982b-3b5a7ed12d9a None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:14.895440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 29/58] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:14.901175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c2c-e4e5-4260-8382-87d3a9fe4cfa None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:14.901624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c2c-e4e5-4260-8382-87d3a9fe4cfa None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:14.901714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c2c-e4e5-4260-8382-87d3a9fe4cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:14.920425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b86e3c2c-e4e5-4260-8382-87d3a9fe4cfa None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:14.922014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b86e3c2c-e4e5-4260-8382-87d3a9fe4cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:14.934313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:14.992455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 30/59] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:15.260162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6301770-8eb1-4610-982b-3b5a7ed12d9a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:15.366923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6301770-8eb1-4610-982b-3b5a7ed12d9a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:15.376136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:15.401127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fad936-a348-461d-9f87-765b829fce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:15.402311 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fad936-a348-461d-9f87-765b829fce19 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:15.402587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fad936-a348-461d-9f87-765b829fce19 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:15.402857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fad936-a348-461d-9f87-765b829fce19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:15.403969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fad936-a348-461d-9f87-765b829fce19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:15.405495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fad936-a348-461d-9f87-765b829fce19 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:15.407055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 30/60] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:15.412619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3c2c-e4e5-4260-8382-87d3a9fe4cfa None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:15.514647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3c2c-e4e5-4260-8382-87d3a9fe4cfa None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:15.549208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ba3c1-4072-44ac-9fd1-28f1d0ef28e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:15.549829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ba3c1-4072-44ac-9fd1-28f1d0ef28e0 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:15.550112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ba3c1-4072-44ac-9fd1-28f1d0ef28e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:15.550387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ba3c1-4072-44ac-9fd1-28f1d0ef28e0 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:15.551048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ba3c1-4072-44ac-9fd1-28f1d0ef28e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:15.552502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ba3c1-4072-44ac-9fd1-28f1d0ef28e0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:15.647434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 31/61] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:36:15 2022] POST /identity/v3/users => generated 275 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:36:18.810615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ec87-572a-461c-8c5f-7fed517772a7 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:18.810615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ec87-572a-461c-8c5f-7fed517772a7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:18.810615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4ec87-572a-461c-8c5f-7fed517772a7 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:18.810615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 31/62] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:18.817029 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fd83-6cf1-4609-9744-c94db08202dc None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:18.817935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fd83-6cf1-4609-9744-c94db08202dc None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:18.818411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fd83-6cf1-4609-9744-c94db08202dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:18.831524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:18.849614 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d9e1fd83-6cf1-4609-9744-c94db08202dc None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:18.850841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d9e1fd83-6cf1-4609-9744-c94db08202dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:18.949385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 32/63] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:19.127952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2a1a-c233-4848-a708-332be78cf4bc None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.128159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2a1a-c233-4848-a708-332be78cf4bc None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.128416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2a1a-c233-4848-a708-332be78cf4bc None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.129972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 32/64] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:19.135567 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326f6e-eba5-447f-8fe2-53a044407131 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.135861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326f6e-eba5-447f-8fe2-53a044407131 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.136144 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326f6e-eba5-447f-8fe2-53a044407131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.166673 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c8326f6e-eba5-447f-8fe2-53a044407131 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:19.167894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c8326f6e-eba5-447f-8fe2-53a044407131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:19.177357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a4a1d-77ad-42ef-96f9-7709703c09a2 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.177635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a4a1d-77ad-42ef-96f9-7709703c09a2 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.178074 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a4a1d-77ad-42ef-96f9-7709703c09a2 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.179877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 33/65] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:19.193374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bf5ab-cb79-45ca-b088-d66376ce59dc None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.194236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bf5ab-cb79-45ca-b088-d66376ce59dc None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.194798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bf5ab-cb79-45ca-b088-d66376ce59dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.299914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 33/66] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:19.357581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c02bf5ab-cb79-45ca-b088-d66376ce59dc None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:19.359162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c02bf5ab-cb79-45ca-b088-d66376ce59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:19.462948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326f6e-eba5-447f-8fe2-53a044407131 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:19.471187 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 34/67] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:19.472576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdccf7-36e3-4673-acc4-dbbcaa3b5606 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.472872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdccf7-36e3-4673-acc4-dbbcaa3b5606 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.473150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdccf7-36e3-4673-acc4-dbbcaa3b5606 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.474698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 35/68] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:19.492216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e39d-adde-448d-bd79-b4fa0f09c10f None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.492559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e39d-adde-448d-bd79-b4fa0f09c10f None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.492807 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6e39d-adde-448d-bd79-b4fa0f09c10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.525632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-23d6e39d-adde-448d-bd79-b4fa0f09c10f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:19.526848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-23d6e39d-adde-448d-bd79-b4fa0f09c10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:19.538691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:19.582320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326f6e-eba5-447f-8fe2-53a044407131 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:19.619426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 36/69] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:19.621057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0c8c-e37d-462f-8d50-b76d46802775 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.621700 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0c8c-e37d-462f-8d50-b76d46802775 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.622305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0c8c-e37d-462f-8d50-b76d46802775 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.623843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 37/70] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:19.629889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce00c6-c385-4930-881b-6bfbfe79354b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.630468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce00c6-c385-4930-881b-6bfbfe79354b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.630936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce00c6-c385-4930-881b-6bfbfe79354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.633841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8819363-b4eb-4912-8d30-47e84a473766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:19.634503 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8819363-b4eb-4912-8d30-47e84a473766 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.634841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8819363-b4eb-4912-8d30-47e84a473766 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.635123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8819363-b4eb-4912-8d30-47e84a473766 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.652957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ecce00c6-c385-4930-881b-6bfbfe79354b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:19.654482 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ecce00c6-c385-4930-881b-6bfbfe79354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:19.656336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8819363-b4eb-4912-8d30-47e84a473766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-a8819363-b4eb-4912-8d30-47e84a473766 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:19.668743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:19.670258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:19.671565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:19.674706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 34/71] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:36:19.681231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8819363-b4eb-4912-8d30-47e84a473766 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:19.691926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:19.739522 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 38/72] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:19.740454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce00c6-c385-4930-881b-6bfbfe79354b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:19.831901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8819363-b4eb-4912-8d30-47e84a473766 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:19.862053 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce00c6-c385-4930-881b-6bfbfe79354b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:19.867574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:19.880725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937490-d5dc-46da-ac29-8380aa46ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:19.881697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937490-d5dc-46da-ac29-8380aa46ce2d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.882262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937490-d5dc-46da-ac29-8380aa46ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.882732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937490-d5dc-46da-ac29-8380aa46ce2d None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.883860 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54937490-d5dc-46da-ac29-8380aa46ce2d None admin] RBAC: Adding query filter params (name=member) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:19.884381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54937490-d5dc-46da-ac29-8380aa46ce2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:19.886140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54937490-d5dc-46da-ac29-8380aa46ce2d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:19.896380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 35/73] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:19.897536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937490-d5dc-46da-ac29-8380aa46ce2d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:19.906056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b8071-ebef-46e4-89fb-d39edd60ff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:19.906934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8071-ebef-46e4-89fb-d39edd60ff29 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:19.907490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8071-ebef-46e4-89fb-d39edd60ff29 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:19.907995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8071-ebef-46e4-89fb-d39edd60ff29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:19.920154 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b8071-ebef-46e4-89fb-d39edd60ff29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-ae9b8071-ebef-46e4-89fb-d39edd60ff29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:19.926036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:19.926898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:19.927666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:19.930414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 39/74] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:36:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:19.931655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b8071-ebef-46e4-89fb-d39edd60ff29 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:19.962823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:20.021719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937490-d5dc-46da-ac29-8380aa46ce2d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.045623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b8071-ebef-46e4-89fb-d39edd60ff29 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.056849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7785c-402b-4ace-9ba5-d2a5e2cf691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.057490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7785c-402b-4ace-9ba5-d2a5e2cf691e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.057768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7785c-402b-4ace-9ba5-d2a5e2cf691e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.058039 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7785c-402b-4ace-9ba5-d2a5e2cf691e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.068207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7785c-402b-4ace-9ba5-d2a5e2cf691e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-6af7785c-402b-4ace-9ba5-d2a5e2cf691e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:20.073409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:20.074818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:20.075627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 36/75] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:36:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:20.077545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7785c-402b-4ace-9ba5-d2a5e2cf691e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:20.083859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c464fe9-e2a2-4868-a3be-a7c8c434a4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.084506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c464fe9-e2a2-4868-a3be-a7c8c434a4a2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.084815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c464fe9-e2a2-4868-a3be-a7c8c434a4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.085092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c464fe9-e2a2-4868-a3be-a7c8c434a4a2 None admin] PATH_INFO: `/v3/users/7476173827d74a3aac24510fe72e7a53` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.101817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c464fe9-e2a2-4868-a3be-a7c8c434a4a2 None admin] RBAC: Authorizing `identity:get_user(user_id=7476173827d74a3aac24510fe72e7a53)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:20.103303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c464fe9-e2a2-4868-a3be-a7c8c434a4a2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:20.109909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 40/76] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:19 2022] GET /identity/v3/users/7476173827d74a3aac24510fe72e7a53 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:20.109909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c464fe9-e2a2-4868-a3be-a7c8c434a4a2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:20.132210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:20.190213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7785c-402b-4ace-9ba5-d2a5e2cf691e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.194497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:20.210584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c464fe9-e2a2-4868-a3be-a7c8c434a4a2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.227229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780b28c-9c43-411d-8582-63ec0a6aa254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.227883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780b28c-9c43-411d-8582-63ec0a6aa254 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.228241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780b28c-9c43-411d-8582-63ec0a6aa254 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.228534 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780b28c-9c43-411d-8582-63ec0a6aa254 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.229208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780b28c-9c43-411d-8582-63ec0a6aa254 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:20.229510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780b28c-9c43-411d-8582-63ec0a6aa254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:20.230902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780b28c-9c43-411d-8582-63ec0a6aa254 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:20.238901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 37/77] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:36:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:20.239744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780b28c-9c43-411d-8582-63ec0a6aa254 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:20.244425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c658f-84c8-4842-9035-0d3b07b332d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.245258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c658f-84c8-4842-9035-0d3b07b332d5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.245546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c658f-84c8-4842-9035-0d3b07b332d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.245823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c658f-84c8-4842-9035-0d3b07b332d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.257310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c658f-84c8-4842-9035-0d3b07b332d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-c70c658f-84c8-4842-9035-0d3b07b332d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:20.262685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:20.263569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:20.264355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 41/78] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:20.265054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c658f-84c8-4842-9035-0d3b07b332d5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:20.342665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780b28c-9c43-411d-8582-63ec0a6aa254 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.350029 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:20.369207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c658f-84c8-4842-9035-0d3b07b332d5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.377801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a2331-05b0-40c0-86e6-f05041dd3140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.378460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a2331-05b0-40c0-86e6-f05041dd3140 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.378770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a2331-05b0-40c0-86e6-f05041dd3140 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.379052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a2331-05b0-40c0-86e6-f05041dd3140 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.380581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a2331-05b0-40c0-86e6-f05041dd3140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:20.382393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a2331-05b0-40c0-86e6-f05041dd3140 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:20.383979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 38/79] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:20.384777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a2331-05b0-40c0-86e6-f05041dd3140 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:20.405853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a06b8-52e3-4f73-9b9c-bdc1f28284ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.406468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a06b8-52e3-4f73-9b9c-bdc1f28284ad None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.406744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a06b8-52e3-4f73-9b9c-bdc1f28284ad None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.407012 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a06b8-52e3-4f73-9b9c-bdc1f28284ad None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.407682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a06b8-52e3-4f73-9b9c-bdc1f28284ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:20.407985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a06b8-52e3-4f73-9b9c-bdc1f28284ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:20.409396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a06b8-52e3-4f73-9b9c-bdc1f28284ad None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:20.417595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 42/80] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:20.420905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a06b8-52e3-4f73-9b9c-bdc1f28284ad None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:20.429919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:20.488087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a2331-05b0-40c0-86e6-f05041dd3140 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.521286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5c263-bb4e-4abd-842b-483bd2ec70bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.521981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c263-bb4e-4abd-842b-483bd2ec70bd None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.522267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c263-bb4e-4abd-842b-483bd2ec70bd None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.522539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c263-bb4e-4abd-842b-483bd2ec70bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.525094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a06b8-52e3-4f73-9b9c-bdc1f28284ad None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.559850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc082d0-4183-40bb-ba43-c48d19b08b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.560486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc082d0-4183-40bb-ba43-c48d19b08b5d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.560805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc082d0-4183-40bb-ba43-c48d19b08b5d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.561085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc082d0-4183-40bb-ba43-c48d19b08b5d None admin] PATH_INFO: `/v3/users/7476173827d74a3aac24510fe72e7a53` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.562325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc082d0-4183-40bb-ba43-c48d19b08b5d None admin] RBAC: Authorizing `identity:get_user(user_id=7476173827d74a3aac24510fe72e7a53)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:20.563780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc082d0-4183-40bb-ba43-c48d19b08b5d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:20.565439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 43/81] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:20 2022] GET /identity/v3/users/7476173827d74a3aac24510fe72e7a53 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:20.566241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc082d0-4183-40bb-ba43-c48d19b08b5d None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:20.571082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:20.594805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5c263-bb4e-4abd-842b-483bd2ec70bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:20.596212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5c263-bb4e-4abd-842b-483bd2ec70bd None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:20.647906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:20.674442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc082d0-4183-40bb-ba43-c48d19b08b5d None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.705359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 39/82] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:20.706142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5c263-bb4e-4abd-842b-483bd2ec70bd None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:20.715982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8cab3-8aae-4c7e-bc2d-6bac6e13d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.716645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8cab3-8aae-4c7e-bc2d-6bac6e13d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.716927 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8cab3-8aae-4c7e-bc2d-6bac6e13d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.717691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8cab3-8aae-4c7e-bc2d-6bac6e13d8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.718372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8cab3-8aae-4c7e-bc2d-6bac6e13d8f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:20.718777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8cab3-8aae-4c7e-bc2d-6bac6e13d8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:20.720050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8cab3-8aae-4c7e-bc2d-6bac6e13d8f4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:20.728558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 44/83] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:20.729292 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8cab3-8aae-4c7e-bc2d-6bac6e13d8f4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:20.786372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:20.812953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5c263-bb4e-4abd-842b-483bd2ec70bd None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.832702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8cab3-8aae-4c7e-bc2d-6bac6e13d8f4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:20.849955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ef177-85d8-4a23-93b4-8b65ebbb0358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.849955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ef177-85d8-4a23-93b4-8b65ebbb0358 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.849955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ef177-85d8-4a23-93b4-8b65ebbb0358 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.849955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ef177-85d8-4a23-93b4-8b65ebbb0358 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.850686 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ef177-85d8-4a23-93b4-8b65ebbb0358 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:20.851080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ef177-85d8-4a23-93b4-8b65ebbb0358 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:20.876851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecd3ef-aee2-424b-9415-bf776998f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:20.903822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd3ef-aee2-424b-9415-bf776998f112 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:20.903822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd3ef-aee2-424b-9415-bf776998f112 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:20.903822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd3ef-aee2-424b-9415-bf776998f112 None admin] PATH_INFO: `/v3/users/b59293d8226b4fba854dac5ea94dd380` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:20.903822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecd3ef-aee2-424b-9415-bf776998f112 None admin] RBAC: Authorizing `identity:get_user(user_id=b59293d8226b4fba854dac5ea94dd380)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:20.903822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecd3ef-aee2-424b-9415-bf776998f112 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:20.903822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 45/84] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:20 2022] GET /identity/v3/users/b59293d8226b4fba854dac5ea94dd380 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:20.904332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecd3ef-aee2-424b-9415-bf776998f112 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:20.904332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:20.989108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecd3ef-aee2-424b-9415-bf776998f112 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:21.014614 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 40/85] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:36:20 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:21.015800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ef177-85d8-4a23-93b4-8b65ebbb0358 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:21.022770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dbcff-d0a4-4e73-b41f-e3add523f869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:21.024438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dbcff-d0a4-4e73-b41f-e3add523f869 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:21.024438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dbcff-d0a4-4e73-b41f-e3add523f869 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:21.024438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dbcff-d0a4-4e73-b41f-e3add523f869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:21.112152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812dbcff-d0a4-4e73-b41f-e3add523f869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:21.113680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812dbcff-d0a4-4e73-b41f-e3add523f869 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:21.118443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:21.148359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ef177-85d8-4a23-93b4-8b65ebbb0358 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:21.184131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:21.191395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f6aec-5e42-4a19-bf8a-3ad1d8236117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:21.196141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f6aec-5e42-4a19-bf8a-3ad1d8236117 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:21.196141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f6aec-5e42-4a19-bf8a-3ad1d8236117 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:21.196141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f6aec-5e42-4a19-bf8a-3ad1d8236117 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:21.196141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f6aec-5e42-4a19-bf8a-3ad1d8236117 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:21.196141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f6aec-5e42-4a19-bf8a-3ad1d8236117 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:21.197043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 41/86] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:21 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:21.198293 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f6aec-5e42-4a19-bf8a-3ad1d8236117 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:21.249164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 46/87] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:21.253467 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dbcff-d0a4-4e73-b41f-e3add523f869 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:21.328072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f6aec-5e42-4a19-bf8a-3ad1d8236117 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:21.374365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a9f85-3c29-4c88-988d-3ce506aeda25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:21.374957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a9f85-3c29-4c88-988d-3ce506aeda25 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:21.375258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a9f85-3c29-4c88-988d-3ce506aeda25 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:21.375619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a9f85-3c29-4c88-988d-3ce506aeda25 None admin] PATH_INFO: `/v3/users/7476173827d74a3aac24510fe72e7a53` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:21.379185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a9f85-3c29-4c88-988d-3ce506aeda25 None admin] RBAC: Authorizing `identity:get_user(user_id=7476173827d74a3aac24510fe72e7a53)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:21.380093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a9f85-3c29-4c88-988d-3ce506aeda25 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:21.382147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 42/88] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:21 2022] GET /identity/v3/users/7476173827d74a3aac24510fe72e7a53 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:21.382790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a9f85-3c29-4c88-988d-3ce506aeda25 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:21.407465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dbcff-d0a4-4e73-b41f-e3add523f869 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:21.420778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:21.453338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01e51c-ad3f-4181-84ca-6c0018e05ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:21.454141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01e51c-ad3f-4181-84ca-6c0018e05ffc None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:21.454473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01e51c-ad3f-4181-84ca-6c0018e05ffc None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:21.455135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01e51c-ad3f-4181-84ca-6c0018e05ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:21.462896 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:21.500829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a9f85-3c29-4c88-988d-3ce506aeda25 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:21.542409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabc9b0-6a83-40ab-b413-19def6b1a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:21.543065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabc9b0-6a83-40ab-b413-19def6b1a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:21.543429 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabc9b0-6a83-40ab-b413-19def6b1a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:21.543713 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabc9b0-6a83-40ab-b413-19def6b1a5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:21.544496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabc9b0-6a83-40ab-b413-19def6b1a5f6 None admin] RBAC: Adding query filter params (role.id=23c81c3dc8f743289ecb566849eb8324, scope.project.id=ebb4d7000b48410e8173e1b4a878579a, user.id=7476173827d74a3aac24510fe72e7a53) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:21.544855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabc9b0-6a83-40ab-b413-19def6b1a5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:21.545206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01e51c-ad3f-4181-84ca-6c0018e05ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:21.546330 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabc9b0-6a83-40ab-b413-19def6b1a5f6 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:21.546679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01e51c-ad3f-4181-84ca-6c0018e05ffc None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:21.553549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 43/89] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:21 2022] GET /identity/v3/role_assignments?user.id=7476173827d74a3aac24510fe72e7a53&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:21.554412 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabc9b0-6a83-40ab-b413-19def6b1a5f6 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:21.734425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 47/90] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:21.736056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01e51c-ad3f-4181-84ca-6c0018e05ffc None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:21.740432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:21.790825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabc9b0-6a83-40ab-b413-19def6b1a5f6 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:21.823520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:21.833373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c42cd-dee4-482d-93b9-e538be6b0869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:21.836575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c42cd-dee4-482d-93b9-e538be6b0869 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:21.836575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c42cd-dee4-482d-93b9-e538be6b0869 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:21.836575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c42cd-dee4-482d-93b9-e538be6b0869 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:21.838371 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c42cd-dee4-482d-93b9-e538be6b0869 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:21.840533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c42cd-dee4-482d-93b9-e538be6b0869 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:21.842556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 44/91] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:21 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:21.843640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c42cd-dee4-482d-93b9-e538be6b0869 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:21.958037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c42cd-dee4-482d-93b9-e538be6b0869 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:21.986595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01e51c-ad3f-4181-84ca-6c0018e05ffc None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:21.999138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300dc9d-3406-41f7-b714-a49d027aa568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:22.000095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300dc9d-3406-41f7-b714-a49d027aa568 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:22.000610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300dc9d-3406-41f7-b714-a49d027aa568 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:22.001081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300dc9d-3406-41f7-b714-a49d027aa568 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:22.002870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300dc9d-3406-41f7-b714-a49d027aa568 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:22.004531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300dc9d-3406-41f7-b714-a49d027aa568 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:22.006376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 45/92] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:21 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:22.007384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300dc9d-3406-41f7-b714-a49d027aa568 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:22.085010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:22.119696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300dc9d-3406-41f7-b714-a49d027aa568 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:22.137660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2660dc-7d79-45ad-a302-9640ba8beb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:22.138575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2660dc-7d79-45ad-a302-9640ba8beb9a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:22.139007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2660dc-7d79-45ad-a302-9640ba8beb9a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:22.139962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2660dc-7d79-45ad-a302-9640ba8beb9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:22.181109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69d28-4889-4d7c-bff4-ba52626ba711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:22.181731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69d28-4889-4d7c-bff4-ba52626ba711 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:22.182009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69d28-4889-4d7c-bff4-ba52626ba711 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:22.182281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69d28-4889-4d7c-bff4-ba52626ba711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:22.183013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b69d28-4889-4d7c-bff4-ba52626ba711 None admin] RBAC: Adding query filter params (role.id=e5562064df7e4f1a96a35d581b4f28c4, scope.project.id=ebb4d7000b48410e8173e1b4a878579a, user.id=7476173827d74a3aac24510fe72e7a53) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:22.183323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b69d28-4889-4d7c-bff4-ba52626ba711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:22.185429 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b69d28-4889-4d7c-bff4-ba52626ba711 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:22.196812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 46/93] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:22 2022] GET /identity/v3/role_assignments?user.id=7476173827d74a3aac24510fe72e7a53&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=e5562064df7e4f1a96a35d581b4f28c4 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:22.198889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69d28-4889-4d7c-bff4-ba52626ba711 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:22.254831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2660dc-7d79-45ad-a302-9640ba8beb9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:22.256259 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2660dc-7d79-45ad-a302-9640ba8beb9a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:22.261175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:22.423211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69d28-4889-4d7c-bff4-ba52626ba711 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:22.444813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 48/94] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:22.451884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2660dc-7d79-45ad-a302-9640ba8beb9a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:22.500444 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:22.516403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468d663-3b36-4fbc-934c-21b0f5d7e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:22.516403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d663-3b36-4fbc-934c-21b0f5d7e541 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:22.516403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d663-3b36-4fbc-934c-21b0f5d7e541 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:22.516403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468d663-3b36-4fbc-934c-21b0f5d7e541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:22.516825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468d663-3b36-4fbc-934c-21b0f5d7e541 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=ebb4d7000b48410e8173e1b4a878579a, user.id=b59293d8226b4fba854dac5ea94dd380) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:22.516825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468d663-3b36-4fbc-934c-21b0f5d7e541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:22.516825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468d663-3b36-4fbc-934c-21b0f5d7e541 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:22.520451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 47/95] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:22 2022] GET /identity/v3/role_assignments?user.id=b59293d8226b4fba854dac5ea94dd380&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=eeb6551eeb934053866fc821b511b5dd => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:22.662950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2660dc-7d79-45ad-a302-9640ba8beb9a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:22.665785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:22.717408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b870dc7-cb8f-49df-9590-9964b1efb8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:22.718083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b870dc7-cb8f-49df-9590-9964b1efb8a9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:22.718370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b870dc7-cb8f-49df-9590-9964b1efb8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:22.718651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b870dc7-cb8f-49df-9590-9964b1efb8a9 None admin] PATH_INFO: `/v3/projects/d2792053c34d4adc8aa7fbd4ac5534ba` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:22.719888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b870dc7-cb8f-49df-9590-9964b1efb8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=d2792053c34d4adc8aa7fbd4ac5534ba)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:22.721404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b870dc7-cb8f-49df-9590-9964b1efb8a9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:22.723126 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 49/96] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:22 2022] GET /identity/v3/projects/d2792053c34d4adc8aa7fbd4ac5534ba => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:22.729228 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468d663-3b36-4fbc-934c-21b0f5d7e541 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:22.859290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468d663-3b36-4fbc-934c-21b0f5d7e541 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:22.900761 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adcc8e-d10a-494c-ae14-9d22dc139dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:22.901759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adcc8e-d10a-494c-ae14-9d22dc139dba None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:22.902257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adcc8e-d10a-494c-ae14-9d22dc139dba None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:22.903282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adcc8e-d10a-494c-ae14-9d22dc139dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:22.904227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adcc8e-d10a-494c-ae14-9d22dc139dba None admin] RBAC: Adding query filter params (role.id=23c81c3dc8f743289ecb566849eb8324, scope.project.id=d2792053c34d4adc8aa7fbd4ac5534ba, user.id=7476173827d74a3aac24510fe72e7a53) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:22.904776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adcc8e-d10a-494c-ae14-9d22dc139dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:22.906472 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adcc8e-d10a-494c-ae14-9d22dc139dba None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:22.917308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 48/97] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:22 2022] GET /identity/v3/role_assignments?user.id=7476173827d74a3aac24510fe72e7a53&scope.project.id=d2792053c34d4adc8aa7fbd4ac5534ba&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:23.608863 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f92c8e-639f-468e-93a4-ae292c37b3b1 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:23.609401 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f92c8e-639f-468e-93a4-ae292c37b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:23.609401 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f92c8e-639f-468e-93a4-ae292c37b3b1 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:23.610795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 50/98] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:23.616341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9317-640d-4c64-88ec-771aceb63b66 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:23.616801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9317-640d-4c64-88ec-771aceb63b66 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:23.616989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d9317-640d-4c64-88ec-771aceb63b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:23.636915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-da9d9317-640d-4c64-88ec-771aceb63b66 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:23.638160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-da9d9317-640d-4c64-88ec-771aceb63b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:23.663300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04b8a8-2107-470c-93d5-c0be30827de4 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:23.663612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04b8a8-2107-470c-93d5-c0be30827de4 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:23.663856 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04b8a8-2107-470c-93d5-c0be30827de4 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:23.665711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 51/99] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:23.678637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16896-c44c-4791-9226-223ce718e26d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:23.678926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16896-c44c-4791-9226-223ce718e26d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:23.679207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16896-c44c-4791-9226-223ce718e26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:23.702216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ecd16896-c44c-4791-9226-223ce718e26d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:23.704028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ecd16896-c44c-4791-9226-223ce718e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:23.736659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:23.778248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 49/100] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:23.795304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 52/101] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:24.176268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9317-640d-4c64-88ec-771aceb63b66 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:24.291011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d9317-640d-4c64-88ec-771aceb63b66 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:24.331921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff4bcd-83c3-4f38-a790-b0865c5889cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:24.332601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff4bcd-83c3-4f38-a790-b0865c5889cb None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:24.332911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff4bcd-83c3-4f38-a790-b0865c5889cb None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:24.333189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff4bcd-83c3-4f38-a790-b0865c5889cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:24.334560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff4bcd-83c3-4f38-a790-b0865c5889cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:24.336042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff4bcd-83c3-4f38-a790-b0865c5889cb None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:24.337806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 50/102] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:24.344172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd16896-c44c-4791-9226-223ce718e26d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:24.356052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff4bcd-83c3-4f38-a790-b0865c5889cb None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:24.467836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:24.498450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd16896-c44c-4791-9226-223ce718e26d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:24.508348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:24.548772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526e08a-b0e0-473c-9b9c-145ee4a74bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:24.550894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526e08a-b0e0-473c-9b9c-145ee4a74bd6 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:24.553625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff4bcd-83c3-4f38-a790-b0865c5889cb None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:24.554332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526e08a-b0e0-473c-9b9c-145ee4a74bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:24.554897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526e08a-b0e0-473c-9b9c-145ee4a74bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:24.555796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526e08a-b0e0-473c-9b9c-145ee4a74bd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:24.557852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526e08a-b0e0-473c-9b9c-145ee4a74bd6 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:24.612251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d0144-d622-41d4-a517-16090d996691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:24.613489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0144-d622-41d4-a517-16090d996691 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:24.614046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0144-d622-41d4-a517-16090d996691 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:24.614619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d0144-d622-41d4-a517-16090d996691 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:24.627319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d0144-d622-41d4-a517-16090d996691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-532d0144-d622-41d4-a517-16090d996691 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:24.633345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:24.634249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:24.635073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:24.638428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 51/103] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:36:24.640187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232fa5-65d7-4a35-b8f7-bbacf0242061 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:24.640800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232fa5-65d7-4a35-b8f7-bbacf0242061 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:24.641311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232fa5-65d7-4a35-b8f7-bbacf0242061 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:24.642908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 52/104] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:24.644623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27232fa5-65d7-4a35-b8f7-bbacf0242061 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:24.679480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 53/105] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:36:24 2022] POST /identity/v3/projects => generated 302 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:24.685162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dc7ca-968b-4125-b277-3ca6f7806f5e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:24.686001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dc7ca-968b-4125-b277-3ca6f7806f5e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:24.687407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dc7ca-968b-4125-b277-3ca6f7806f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:24.733347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e74dc7ca-968b-4125-b277-3ca6f7806f5e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:24.734663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e74dc7ca-968b-4125-b277-3ca6f7806f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:24.802554 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27232fa5-65d7-4a35-b8f7-bbacf0242061 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:24.826499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:24.851156 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4925-b732-4853-a6d1-cd4ac4558281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:24.852133 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4925-b732-4853-a6d1-cd4ac4558281 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:24.852668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4925-b732-4853-a6d1-cd4ac4558281 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:24.853169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4925-b732-4853-a6d1-cd4ac4558281 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:24.854117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4925-b732-4853-a6d1-cd4ac4558281 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:24.854604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4925-b732-4853-a6d1-cd4ac4558281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:24.857865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e4925-b732-4853-a6d1-cd4ac4558281 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:24.869172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 53/106] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:24.877287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4925-b732-4853-a6d1-cd4ac4558281 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:24.916551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 54/107] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:25.034231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4925-b732-4853-a6d1-cd4ac4558281 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:25.075711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f706-bdab-4e15-a02e-d688eb03bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:25.076349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f706-bdab-4e15-a02e-d688eb03bf3e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:25.076740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f706-bdab-4e15-a02e-d688eb03bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:25.077130 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f706-bdab-4e15-a02e-d688eb03bf3e None admin] PATH_INFO: `/v3/users/140476a9ae5e42a0a5160d4d1cac85e7` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:25.098324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7f706-bdab-4e15-a02e-d688eb03bf3e None admin] RBAC: Authorizing `identity:get_user(user_id=140476a9ae5e42a0a5160d4d1cac85e7)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:25.100173 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7f706-bdab-4e15-a02e-d688eb03bf3e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:25.102178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 54/108] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:24 2022] GET /identity/v3/users/140476a9ae5e42a0a5160d4d1cac85e7 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:25.109107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dc7ca-968b-4125-b277-3ca6f7806f5e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:25.229235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:25.247317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dc7ca-968b-4125-b277-3ca6f7806f5e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:25.294359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d54f-9535-459a-a5cd-1fbe204e130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:25.295557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d54f-9535-459a-a5cd-1fbe204e130b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:25.296079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d54f-9535-459a-a5cd-1fbe204e130b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:25.296808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d54f-9535-459a-a5cd-1fbe204e130b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:25.297682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f706-bdab-4e15-a02e-d688eb03bf3e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:25.390815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410d54f-9535-459a-a5cd-1fbe204e130b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:25.392659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410d54f-9535-459a-a5cd-1fbe204e130b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:25.394484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:25.492909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:25.512320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 55/109] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:25.514114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650935be-62a1-4954-b7db-96df966f813c None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:25.514629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650935be-62a1-4954-b7db-96df966f813c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:25.515384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650935be-62a1-4954-b7db-96df966f813c None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:25.516917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 56/110] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:25.521455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650935be-62a1-4954-b7db-96df966f813c None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:25.594125 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f706-bdab-4e15-a02e-d688eb03bf3e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:25.643420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650935be-62a1-4954-b7db-96df966f813c None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:25.684937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2939e-6df3-4f39-86a9-dbb26b658b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:25.686428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2939e-6df3-4f39-86a9-dbb26b658b2d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:25.686923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2939e-6df3-4f39-86a9-dbb26b658b2d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:25.687510 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2939e-6df3-4f39-86a9-dbb26b658b2d None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:25.689137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2939e-6df3-4f39-86a9-dbb26b658b2d None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:25.690842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2939e-6df3-4f39-86a9-dbb26b658b2d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:25.693870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 57/111] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:25 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:25.695669 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988620b-8af9-42e5-a6e0-2913675d6422 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:25.696167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988620b-8af9-42e5-a6e0-2913675d6422 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:25.696726 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988620b-8af9-42e5-a6e0-2913675d6422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:25.704339 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5801cf-9600-4975-8b3c-9e359d5496ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:25.705096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5801cf-9600-4975-8b3c-9e359d5496ab None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:25.705386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5801cf-9600-4975-8b3c-9e359d5496ab None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:25.705660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5801cf-9600-4975-8b3c-9e359d5496ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:25.717991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5801cf-9600-4975-8b3c-9e359d5496ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:25.720710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3988620b-8af9-42e5-a6e0-2913675d6422 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:25.722160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3988620b-8af9-42e5-a6e0-2913675d6422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-dd5801cf-9600-4975-8b3c-9e359d5496ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:25.727584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:25.728476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:25.729306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 55/112] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:36:25.730047 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5801cf-9600-4975-8b3c-9e359d5496ab None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:25.804558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:25.818928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 58/113] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:25.820186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88284b2-18ce-45e7-83c8-5f270c7a785a None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:25.820501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88284b2-18ce-45e7-83c8-5f270c7a785a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:25.820822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88284b2-18ce-45e7-83c8-5f270c7a785a None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:25.822356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 59/114] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:25.822937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88284b2-18ce-45e7-83c8-5f270c7a785a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:25.858504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:25.866531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5801cf-9600-4975-8b3c-9e359d5496ab None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:25.910275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16814-dcbf-4899-aff0-1dafb3823e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:25.911274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16814-dcbf-4899-aff0-1dafb3823e1a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:25.911751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16814-dcbf-4899-aff0-1dafb3823e1a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:25.912248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16814-dcbf-4899-aff0-1dafb3823e1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:25.913185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16814-dcbf-4899-aff0-1dafb3823e1a None admin] RBAC: Adding query filter params (role.id=0be962a218de4ebd87c3062a16459c98, scope.project.id=ebb4d7000b48410e8173e1b4a878579a, user.id=140476a9ae5e42a0a5160d4d1cac85e7) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:25.913729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16814-dcbf-4899-aff0-1dafb3823e1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:25.915397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16814-dcbf-4899-aff0-1dafb3823e1a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:25.922900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 56/115] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:25 2022] GET /identity/v3/role_assignments?user.id=140476a9ae5e42a0a5160d4d1cac85e7&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=0be962a218de4ebd87c3062a16459c98 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:25.924783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a9c2-7a01-4373-a4e4-72fe08445f4b None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:25.925281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a9c2-7a01-4373-a4e4-72fe08445f4b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:25.926012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0a9c2-7a01-4373-a4e4-72fe08445f4b None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:25.927876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 57/116] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:25.929363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e4e93-bb34-4793-9531-d03f3609a840 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:25.929859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e4e93-bb34-4793-9531-d03f3609a840 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:25.930292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e4e93-bb34-4793-9531-d03f3609a840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:25.973159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-a21e4e93-bb34-4793-9531-d03f3609a840 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:25.973159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a21e4e93-bb34-4793-9531-d03f3609a840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:25.977500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88284b2-18ce-45e7-83c8-5f270c7a785a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:26.057428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354925c5-a331-42c2-a657-4c94d2453f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:26.058115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354925c5-a331-42c2-a657-4c94d2453f1d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:26.058397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354925c5-a331-42c2-a657-4c94d2453f1d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:26.058748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354925c5-a331-42c2-a657-4c94d2453f1d None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:26.059442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354925c5-a331-42c2-a657-4c94d2453f1d None admin] RBAC: Adding query filter params (name=member) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:26.059750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354925c5-a331-42c2-a657-4c94d2453f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:26.061187 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354925c5-a331-42c2-a657-4c94d2453f1d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:26.080005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 60/117] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:26.081407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17839-ec5b-4b90-be2c-063887a90e8d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:26.081829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17839-ec5b-4b90-be2c-063887a90e8d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:26.082106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df17839-ec5b-4b90-be2c-063887a90e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:26.106688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 58/118] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:26.107615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e4e93-bb34-4793-9531-d03f3609a840 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:26.120382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-9df17839-ec5b-4b90-be2c-063887a90e8d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:26.121754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9df17839-ec5b-4b90-be2c-063887a90e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:26.171747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:26.210203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 61/119] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:26.211150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df17839-ec5b-4b90-be2c-063887a90e8d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:26.279468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:26.298754 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e4e93-bb34-4793-9531-d03f3609a840 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:26.364878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df8762-a4de-43e3-aba6-6a158caeebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:26.365528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df8762-a4de-43e3-aba6-6a158caeebdd None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:26.365815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df8762-a4de-43e3-aba6-6a158caeebdd None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:26.366106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df8762-a4de-43e3-aba6-6a158caeebdd None admin] PATH_INFO: `/v3/users/7476173827d74a3aac24510fe72e7a53` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:26.367461 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df8762-a4de-43e3-aba6-6a158caeebdd None admin] RBAC: Authorizing `identity:get_user(user_id=7476173827d74a3aac24510fe72e7a53)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:26.370327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df8762-a4de-43e3-aba6-6a158caeebdd None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:26.371984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 59/120] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:26 2022] GET /identity/v3/users/7476173827d74a3aac24510fe72e7a53 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:26.378052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df8762-a4de-43e3-aba6-6a158caeebdd None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:26.386079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df17839-ec5b-4b90-be2c-063887a90e8d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:26.469321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bfd7e-8bab-4e60-8fdc-c0fabdc87847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:26.469898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bfd7e-8bab-4e60-8fdc-c0fabdc87847 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:26.470183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bfd7e-8bab-4e60-8fdc-c0fabdc87847 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:26.470460 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bfd7e-8bab-4e60-8fdc-c0fabdc87847 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:26.501619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bfd7e-8bab-4e60-8fdc-c0fabdc87847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-aa5bfd7e-8bab-4e60-8fdc-c0fabdc87847 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:26.506477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:26.507514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:26.508489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:26.512601 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 62/121] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:36:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:26.513490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bfd7e-8bab-4e60-8fdc-c0fabdc87847 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:26.534710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df8762-a4de-43e3-aba6-6a158caeebdd None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:26.581655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:26.621676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c312e9-16b7-4b1d-802c-91af993d1759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:26.622341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c312e9-16b7-4b1d-802c-91af993d1759 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:26.622624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c312e9-16b7-4b1d-802c-91af993d1759 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:26.622901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c312e9-16b7-4b1d-802c-91af993d1759 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:26.625048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c312e9-16b7-4b1d-802c-91af993d1759 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:26.628035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c312e9-16b7-4b1d-802c-91af993d1759 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:26.636910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 60/122] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:26 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:26.637885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c312e9-16b7-4b1d-802c-91af993d1759 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:26.675366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:26.711524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bfd7e-8bab-4e60-8fdc-c0fabdc87847 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:26.751524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515029b-233d-4a5b-83e1-75abb6e5aca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:26.752227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515029b-233d-4a5b-83e1-75abb6e5aca7 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:26.752540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515029b-233d-4a5b-83e1-75abb6e5aca7 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:26.752835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515029b-233d-4a5b-83e1-75abb6e5aca7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:26.764367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515029b-233d-4a5b-83e1-75abb6e5aca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9515029b-233d-4a5b-83e1-75abb6e5aca7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:26.769502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:26.770373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:26.771151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 63/123] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:26.771802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515029b-233d-4a5b-83e1-75abb6e5aca7 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:26.772914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c312e9-16b7-4b1d-802c-91af993d1759 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:26.820885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c00c4-401e-49db-8405-88528a93abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:26.821652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c00c4-401e-49db-8405-88528a93abb7 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:26.822003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c00c4-401e-49db-8405-88528a93abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:26.822403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c00c4-401e-49db-8405-88528a93abb7 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:26.823146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c00c4-401e-49db-8405-88528a93abb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:26.823528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c00c4-401e-49db-8405-88528a93abb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:26.825081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c00c4-401e-49db-8405-88528a93abb7 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:26.834418 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 61/124] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:36:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:26.835182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c00c4-401e-49db-8405-88528a93abb7 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:26.891583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:26.906464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515029b-233d-4a5b-83e1-75abb6e5aca7 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:26.946530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b9bf0-ad9b-46f9-88d0-3d65f22209f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:26.947467 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b9bf0-ad9b-46f9-88d0-3d65f22209f1 None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:26.947896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b9bf0-ad9b-46f9-88d0-3d65f22209f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:26.948305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b9bf0-ad9b-46f9-88d0-3d65f22209f1 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a/users/7476173827d74a3aac24510fe72e7a53/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:26.950992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b9bf0-ad9b-46f9-88d0-3d65f22209f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebb4d7000b48410e8173e1b4a878579a, user_id=7476173827d74a3aac24510fe72e7a53, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:26.952649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b9bf0-ad9b-46f9-88d0-3d65f22209f1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:26.955975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:26.971607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c00c4-401e-49db-8405-88528a93abb7 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:27.006522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0360cea-6b67-46ba-9458-4d1c081f05b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:27.007090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360cea-6b67-46ba-9458-4d1c081f05b9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:27.007400 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360cea-6b67-46ba-9458-4d1c081f05b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:27.007729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0360cea-6b67-46ba-9458-4d1c081f05b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:27.021635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0360cea-6b67-46ba-9458-4d1c081f05b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-e0360cea-6b67-46ba-9458-4d1c081f05b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:27.026631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:27.028275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 62/125] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:27.029413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0360cea-6b67-46ba-9458-4d1c081f05b9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:27.063502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 64/126] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:36:26 2022] PUT /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a/users/7476173827d74a3aac24510fe72e7a53/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:36:27.065039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b9bf0-ad9b-46f9-88d0-3d65f22209f1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:27.224070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0360cea-6b67-46ba-9458-4d1c081f05b9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:27.275933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71f481-341f-440a-a1a4-f70cc5ad4a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:27.276932 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71f481-341f-440a-a1a4-f70cc5ad4a2e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:27.277984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71f481-341f-440a-a1a4-f70cc5ad4a2e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:27.278481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71f481-341f-440a-a1a4-f70cc5ad4a2e None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:27.279343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71f481-341f-440a-a1a4-f70cc5ad4a2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:27.279893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71f481-341f-440a-a1a4-f70cc5ad4a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:27.282214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71f481-341f-440a-a1a4-f70cc5ad4a2e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:27.286937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b9bf0-ad9b-46f9-88d0-3d65f22209f1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:27.291712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 63/127] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:27.293774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71f481-341f-440a-a1a4-f70cc5ad4a2e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:27.307705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:27.332283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21da8e-bdaf-48cd-94b6-5f54e8baece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:27.333235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21da8e-bdaf-48cd-94b6-5f54e8baece2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:27.333663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21da8e-bdaf-48cd-94b6-5f54e8baece2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:27.334197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21da8e-bdaf-48cd-94b6-5f54e8baece2 None admin] PATH_INFO: `/v3/users/7476173827d74a3aac24510fe72e7a53` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:27.335733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21da8e-bdaf-48cd-94b6-5f54e8baece2 None admin] RBAC: Authorizing `identity:get_user(user_id=7476173827d74a3aac24510fe72e7a53)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:27.337474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21da8e-bdaf-48cd-94b6-5f54e8baece2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:27.339364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 65/128] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:27 2022] GET /identity/v3/users/7476173827d74a3aac24510fe72e7a53 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:27.340946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21da8e-bdaf-48cd-94b6-5f54e8baece2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:27.370163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:27.407898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71f481-341f-440a-a1a4-f70cc5ad4a2e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:27.455287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c345b-b658-4939-be81-7d18e06164b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:27.456622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c345b-b658-4939-be81-7d18e06164b4 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:27.457805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c345b-b658-4939-be81-7d18e06164b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:27.458543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c345b-b658-4939-be81-7d18e06164b4 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:27.459677 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c345b-b658-4939-be81-7d18e06164b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:27.460437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c345b-b658-4939-be81-7d18e06164b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:27.462954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c345b-b658-4939-be81-7d18e06164b4 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:27.471784 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21da8e-bdaf-48cd-94b6-5f54e8baece2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:27.478005 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 64/129] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:27.483470 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c345b-b658-4939-be81-7d18e06164b4 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:27.517315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eaf42-6d78-4d96-8d7c-7807aa751486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:27.518110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eaf42-6d78-4d96-8d7c-7807aa751486 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:27.518509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eaf42-6d78-4d96-8d7c-7807aa751486 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:27.518880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eaf42-6d78-4d96-8d7c-7807aa751486 None admin] PATH_INFO: `/v3/users/b59293d8226b4fba854dac5ea94dd380` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:27.520239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eaf42-6d78-4d96-8d7c-7807aa751486 None admin] RBAC: Authorizing `identity:get_user(user_id=b59293d8226b4fba854dac5ea94dd380)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:27.522050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eaf42-6d78-4d96-8d7c-7807aa751486 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:27.523957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 66/130] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:27 2022] GET /identity/v3/users/b59293d8226b4fba854dac5ea94dd380 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:27.529312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a09377-bc73-4060-89a9-144426b03a33 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:27.529312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a09377-bc73-4060-89a9-144426b03a33 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:27.529312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a09377-bc73-4060-89a9-144426b03a33 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:27.529312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 67/131] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:27.529312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a09377-bc73-4060-89a9-144426b03a33 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:27.586997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:27.625598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c345b-b658-4939-be81-7d18e06164b4 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:27.656807 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:27.669046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a09377-bc73-4060-89a9-144426b03a33 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:27.670898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365184e6-25fa-423b-93e0-338001e1f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:27.671815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365184e6-25fa-423b-93e0-338001e1f1fa None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:27.672177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365184e6-25fa-423b-93e0-338001e1f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:27.672457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365184e6-25fa-423b-93e0-338001e1f1fa None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:27.674812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365184e6-25fa-423b-93e0-338001e1f1fa None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:27.677800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365184e6-25fa-423b-93e0-338001e1f1fa None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:27.678396 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 65/132] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:27 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:27.679010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365184e6-25fa-423b-93e0-338001e1f1fa None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:27.717430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddd400-8527-4b9a-94af-c416607be5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:27.719103 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddd400-8527-4b9a-94af-c416607be5f6 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:27.719781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddd400-8527-4b9a-94af-c416607be5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:27.720664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddd400-8527-4b9a-94af-c416607be5f6 None admin] PATH_INFO: `/v3/users/7476173827d74a3aac24510fe72e7a53` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:27.722528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddd400-8527-4b9a-94af-c416607be5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=7476173827d74a3aac24510fe72e7a53)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:27.724425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddd400-8527-4b9a-94af-c416607be5f6 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:27.726478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 68/133] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:27 2022] GET /identity/v3/users/7476173827d74a3aac24510fe72e7a53 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:27.727924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535e43a-902e-432b-ab15-2c0f6f406598 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:27.728417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535e43a-902e-432b-ab15-2c0f6f406598 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:27.728977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535e43a-902e-432b-ab15-2c0f6f406598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:27.749599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-f535e43a-902e-432b-ab15-2c0f6f406598 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:27.751472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f535e43a-902e-432b-ab15-2c0f6f406598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:27.812607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365184e6-25fa-423b-93e0-338001e1f1fa None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:27.834948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 69/134] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:27.835585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535e43a-902e-432b-ab15-2c0f6f406598 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:27.863406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d56e21-497c-4140-92d4-6c3747912880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:27.864115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d56e21-497c-4140-92d4-6c3747912880 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:27.864404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d56e21-497c-4140-92d4-6c3747912880 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:27.864713 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d56e21-497c-4140-92d4-6c3747912880 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:27.868789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d56e21-497c-4140-92d4-6c3747912880 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:27.870285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d56e21-497c-4140-92d4-6c3747912880 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:27.872202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 66/135] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:27 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:27.872915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d56e21-497c-4140-92d4-6c3747912880 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:27.894399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:27.936488 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:27.978458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535e43a-902e-432b-ab15-2c0f6f406598 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:28.019050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d56e21-497c-4140-92d4-6c3747912880 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:28.059286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b504f-db43-4791-bb79-26e8b4682d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:28.060725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b504f-db43-4791-bb79-26e8b4682d9f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:28.061211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b504f-db43-4791-bb79-26e8b4682d9f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:28.061974 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b504f-db43-4791-bb79-26e8b4682d9f None admin] PATH_INFO: `/v3/projects/d2792053c34d4adc8aa7fbd4ac5534ba` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:28.064242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b504f-db43-4791-bb79-26e8b4682d9f None admin] RBAC: Authorizing `identity:get_project(project_id=d2792053c34d4adc8aa7fbd4ac5534ba)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:28.066123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b504f-db43-4791-bb79-26e8b4682d9f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:28.067978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 67/136] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:27 2022] GET /identity/v3/projects/d2792053c34d4adc8aa7fbd4ac5534ba => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:28.069172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b504f-db43-4791-bb79-26e8b4682d9f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:28.075126 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1be22e-ce63-427b-b640-96da4af8d167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:28.075814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be22e-ce63-427b-b640-96da4af8d167 None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:28.076099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be22e-ce63-427b-b640-96da4af8d167 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:28.076375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be22e-ce63-427b-b640-96da4af8d167 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a/users/7476173827d74a3aac24510fe72e7a53/roles/e5562064df7e4f1a96a35d581b4f28c4` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:28.082942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1be22e-ce63-427b-b640-96da4af8d167 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebb4d7000b48410e8173e1b4a878579a, user_id=7476173827d74a3aac24510fe72e7a53, role_id=e5562064df7e4f1a96a35d581b4f28c4)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:28.085360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1be22e-ce63-427b-b640-96da4af8d167 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:28.160391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:28.185486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b504f-db43-4791-bb79-26e8b4682d9f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:28.216716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 70/137] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:36:27 2022] PUT /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a/users/7476173827d74a3aac24510fe72e7a53/roles/e5562064df7e4f1a96a35d581b4f28c4 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:36:28.218394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1be22e-ce63-427b-b640-96da4af8d167 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:28.233451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e71b92-3745-46da-bb03-6294c8300591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:28.235883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e71b92-3745-46da-bb03-6294c8300591 None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:28.236440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e71b92-3745-46da-bb03-6294c8300591 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:28.237009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e71b92-3745-46da-bb03-6294c8300591 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a/users/b59293d8226b4fba854dac5ea94dd380/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:28.239529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e71b92-3745-46da-bb03-6294c8300591 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebb4d7000b48410e8173e1b4a878579a, user_id=b59293d8226b4fba854dac5ea94dd380, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:28.241442 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e71b92-3745-46da-bb03-6294c8300591 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:28.326370 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 68/138] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:36:28 2022] PUT /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a/users/b59293d8226b4fba854dac5ea94dd380/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:36:28.329623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18653a18-8679-431f-9f91-9923acd09348 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:28.330179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18653a18-8679-431f-9f91-9923acd09348 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:28.330678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18653a18-8679-431f-9f91-9923acd09348 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:28.337784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 69/139] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:28.339200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18653a18-8679-431f-9f91-9923acd09348 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:28.376803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1be22e-ce63-427b-b640-96da4af8d167 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:28.442192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eea41-52fe-46d6-8cf8-cbe4b83f97de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:28.443455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eea41-52fe-46d6-8cf8-cbe4b83f97de None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:28.443858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eea41-52fe-46d6-8cf8-cbe4b83f97de None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:28.444143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eea41-52fe-46d6-8cf8-cbe4b83f97de None admin] PATH_INFO: `/v3/projects/d2792053c34d4adc8aa7fbd4ac5534ba/users/7476173827d74a3aac24510fe72e7a53/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:28.446745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eea41-52fe-46d6-8cf8-cbe4b83f97de None admin] RBAC: Authorizing `identity:create_grant(project_id=d2792053c34d4adc8aa7fbd4ac5534ba, user_id=7476173827d74a3aac24510fe72e7a53, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:28.449849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eea41-52fe-46d6-8cf8-cbe4b83f97de None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:28.502578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18653a18-8679-431f-9f91-9923acd09348 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:28.541828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed70d1-700f-4d3d-9066-f8d1d4b4f2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:28.542473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed70d1-700f-4d3d-9066-f8d1d4b4f2d9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:28.543298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed70d1-700f-4d3d-9066-f8d1d4b4f2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:28.543578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed70d1-700f-4d3d-9066-f8d1d4b4f2d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:28.543916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 71/140] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:36:28 2022] PUT /identity/v3/projects/d2792053c34d4adc8aa7fbd4ac5534ba/users/7476173827d74a3aac24510fe72e7a53/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:36:28.544813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed70d1-700f-4d3d-9066-f8d1d4b4f2d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:28.545940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae4e2-deac-4d16-9308-9cdcd9958b91 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:28.546552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae4e2-deac-4d16-9308-9cdcd9958b91 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:28.546654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed70d1-700f-4d3d-9066-f8d1d4b4f2d9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:28.547136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae4e2-deac-4d16-9308-9cdcd9958b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:28.548282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 70/141] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:28.554589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed70d1-700f-4d3d-9066-f8d1d4b4f2d9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:28.560538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:28.574136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7afae4e2-deac-4d16-9308-9cdcd9958b91 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:28.576785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7afae4e2-deac-4d16-9308-9cdcd9958b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:28.580428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:28.664183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 72/142] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:28.681897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed70d1-700f-4d3d-9066-f8d1d4b4f2d9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:28.739903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dc6b7-22e9-493e-bc76-7eb137347e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:28.740570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dc6b7-22e9-493e-bc76-7eb137347e75 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:28.740854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dc6b7-22e9-493e-bc76-7eb137347e75 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:28.741124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277dc6b7-22e9-493e-bc76-7eb137347e75 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:28.741795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277dc6b7-22e9-493e-bc76-7eb137347e75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:28.743281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277dc6b7-22e9-493e-bc76-7eb137347e75 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:28.883733 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 71/143] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:36:28 2022] POST /identity/v3/users => generated 283 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:36:29.188957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae4e2-deac-4d16-9308-9cdcd9958b91 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:29.329161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae4e2-deac-4d16-9308-9cdcd9958b91 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:29.372542 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0f35d-a27c-4d07-8687-3f5f8bd900d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:29.372542 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0f35d-a27c-4d07-8687-3f5f8bd900d1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:29.372797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0f35d-a27c-4d07-8687-3f5f8bd900d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:29.372997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0f35d-a27c-4d07-8687-3f5f8bd900d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:29.385665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:29.390389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0f35d-a27c-4d07-8687-3f5f8bd900d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-7af0f35d-a27c-4d07-8687-3f5f8bd900d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:29.395603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:29.396471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:29.397258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:29.401372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 73/144] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:29.408051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dc6b7-22e9-493e-bc76-7eb137347e75 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:29.509595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1198fb-d189-4e1f-9e3f-719a6aeebfc4 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:29.509913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1198fb-d189-4e1f-9e3f-719a6aeebfc4 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:29.510275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1198fb-d189-4e1f-9e3f-719a6aeebfc4 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:29.512633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 74/145] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:36:29.513048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:29.524064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313330f-b07d-47fe-bca7-addde6f1595b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:29.524064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313330f-b07d-47fe-bca7-addde6f1595b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:29.524064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313330f-b07d-47fe-bca7-addde6f1595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:29.561084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4313330f-b07d-47fe-bca7-addde6f1595b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:29.562650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4313330f-b07d-47fe-bca7-addde6f1595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:29.564848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277dc6b7-22e9-493e-bc76-7eb137347e75 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:29.615811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac655383-484b-4844-bdc5-657b4f5281fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:29.616440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac655383-484b-4844-bdc5-657b4f5281fb None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:29.616835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac655383-484b-4844-bdc5-657b4f5281fb None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:29.617110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac655383-484b-4844-bdc5-657b4f5281fb None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:29.617778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac655383-484b-4844-bdc5-657b4f5281fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:29.618076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac655383-484b-4844-bdc5-657b4f5281fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:29.619464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac655383-484b-4844-bdc5-657b4f5281fb None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:29.632783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 72/146] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:29.640927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac655383-484b-4844-bdc5-657b4f5281fb None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:29.713877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 75/147] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:29.813838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac655383-484b-4844-bdc5-657b4f5281fb None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:29.840493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:29.856469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e65a4-2347-43b6-8276-5208c21f56b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:29.878870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e65a4-2347-43b6-8276-5208c21f56b1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:29.878870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e65a4-2347-43b6-8276-5208c21f56b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:29.878870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e65a4-2347-43b6-8276-5208c21f56b1 None admin] PATH_INFO: `/v3/users/140476a9ae5e42a0a5160d4d1cac85e7` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:29.878870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e65a4-2347-43b6-8276-5208c21f56b1 None admin] RBAC: Authorizing `identity:get_user(user_id=140476a9ae5e42a0a5160d4d1cac85e7)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:29.878870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e65a4-2347-43b6-8276-5208c21f56b1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:29.878870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 73/148] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:29 2022] GET /identity/v3/users/140476a9ae5e42a0a5160d4d1cac85e7 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:29.879284 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313330f-b07d-47fe-bca7-addde6f1595b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:30.002305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313330f-b07d-47fe-bca7-addde6f1595b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:30.034559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:30.045237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd34d9b-b305-46f1-a90a-00738ace6820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:30.045900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd34d9b-b305-46f1-a90a-00738ace6820 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:30.050432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd34d9b-b305-46f1-a90a-00738ace6820 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:30.050432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd34d9b-b305-46f1-a90a-00738ace6820 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:30.050432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd34d9b-b305-46f1-a90a-00738ace6820 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:30.050432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd34d9b-b305-46f1-a90a-00738ace6820 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:30.051538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 76/149] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:29 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:30.057253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e65a4-2347-43b6-8276-5208c21f56b1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:30.116001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd34d9b-b305-46f1-a90a-00738ace6820 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:30.244345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e65a4-2347-43b6-8276-5208c21f56b1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:30.344311 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd34d9b-b305-46f1-a90a-00738ace6820 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:30.349654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90bfd9-c868-45ff-9c71-938a67d36563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:30.350464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90bfd9-c868-45ff-9c71-938a67d36563 None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:30.350744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90bfd9-c868-45ff-9c71-938a67d36563 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:30.351090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90bfd9-c868-45ff-9c71-938a67d36563 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a/users/140476a9ae5e42a0a5160d4d1cac85e7/roles/0be962a218de4ebd87c3062a16459c98` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:30.353356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90bfd9-c868-45ff-9c71-938a67d36563 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebb4d7000b48410e8173e1b4a878579a, user_id=140476a9ae5e42a0a5160d4d1cac85e7, role_id=0be962a218de4ebd87c3062a16459c98)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:30.354957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90bfd9-c868-45ff-9c71-938a67d36563 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:30.425981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d900a7-4c79-4c42-a450-9de793cdbbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:30.426953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d900a7-4c79-4c42-a450-9de793cdbbc3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:30.427431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d900a7-4c79-4c42-a450-9de793cdbbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:30.427897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d900a7-4c79-4c42-a450-9de793cdbbc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:30.441884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d900a7-4c79-4c42-a450-9de793cdbbc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-40d900a7-4c79-4c42-a450-9de793cdbbc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:30.450384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:30.452068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:30.454176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:30.456405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 77/150] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:36:30.463337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d900a7-4c79-4c42-a450-9de793cdbbc3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:30.465848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 74/151] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:36:30 2022] PUT /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a/users/140476a9ae5e42a0a5160d4d1cac85e7/roles/0be962a218de4ebd87c3062a16459c98 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:36:30.545394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:30.598368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d900a7-4c79-4c42-a450-9de793cdbbc3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:30.645031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7410be4-27e7-4259-b85f-714610247294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:30.646145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7410be4-27e7-4259-b85f-714610247294 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:30.646671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7410be4-27e7-4259-b85f-714610247294 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:30.647176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7410be4-27e7-4259-b85f-714610247294 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:30.648096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7410be4-27e7-4259-b85f-714610247294 None admin] RBAC: Adding query filter params (name=member) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:30.648656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7410be4-27e7-4259-b85f-714610247294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:30.650298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7410be4-27e7-4259-b85f-714610247294 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:30.665450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 78/152] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:30.674822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90bfd9-c868-45ff-9c71-938a67d36563 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:30.780190 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:30.859670 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90bfd9-c868-45ff-9c71-938a67d36563 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:30.917565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288814f-c870-4bdd-a5a8-afb78c75eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:30.919062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288814f-c870-4bdd-a5a8-afb78c75eb4d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:30.919544 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288814f-c870-4bdd-a5a8-afb78c75eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:30.919972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288814f-c870-4bdd-a5a8-afb78c75eb4d None admin] PATH_INFO: `/v3/users/7476173827d74a3aac24510fe72e7a53` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:30.921438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288814f-c870-4bdd-a5a8-afb78c75eb4d None admin] RBAC: Authorizing `identity:get_user(user_id=7476173827d74a3aac24510fe72e7a53)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:30.923743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288814f-c870-4bdd-a5a8-afb78c75eb4d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:30.926281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 75/153] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:30 2022] GET /identity/v3/users/7476173827d74a3aac24510fe72e7a53 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:30.932694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7410be4-27e7-4259-b85f-714610247294 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:31.092465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7410be4-27e7-4259-b85f-714610247294 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:31.110443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:31.134808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2794a0-b61e-4f5c-974f-6ce6036a2e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:31.135484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2794a0-b61e-4f5c-974f-6ce6036a2e2b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:31.135760 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2794a0-b61e-4f5c-974f-6ce6036a2e2b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:31.136080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2794a0-b61e-4f5c-974f-6ce6036a2e2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:31.222344 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2794a0-b61e-4f5c-974f-6ce6036a2e2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:31.223994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2794a0-b61e-4f5c-974f-6ce6036a2e2b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:31.368238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 79/154] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:31.380019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288814f-c870-4bdd-a5a8-afb78c75eb4d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:31.550590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288814f-c870-4bdd-a5a8-afb78c75eb4d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:31.577389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:31.604197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558d1d0-32fc-4573-8c90-f737eab28424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:31.604994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558d1d0-32fc-4573-8c90-f737eab28424 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:31.605437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558d1d0-32fc-4573-8c90-f737eab28424 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:31.605800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558d1d0-32fc-4573-8c90-f737eab28424 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:31.607095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558d1d0-32fc-4573-8c90-f737eab28424 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:31.608671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558d1d0-32fc-4573-8c90-f737eab28424 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:31.610594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 76/155] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:31 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:31.620083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2794a0-b61e-4f5c-974f-6ce6036a2e2b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:31.669671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:31.673128 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0d13-d673-4b8a-8e8f-d55d86840a6e None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:31.673666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0d13-d673-4b8a-8e8f-d55d86840a6e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:31.673954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a0d13-d673-4b8a-8e8f-d55d86840a6e None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:31.675600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 77/156] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:31.681347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f43b1-04e0-4c22-98c9-5d4dc935caa1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:31.681695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f43b1-04e0-4c22-98c9-5d4dc935caa1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:31.681979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f43b1-04e0-4c22-98c9-5d4dc935caa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:31.720645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-1e4f43b1-04e0-4c22-98c9-5d4dc935caa1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:31.721927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1e4f43b1-04e0-4c22-98c9-5d4dc935caa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:31.832661 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2794a0-b61e-4f5c-974f-6ce6036a2e2b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:31.870610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 78/157] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:31.872990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1ffe3-5b90-4b14-b35c-797d2ab91e4d None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:31.873335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1ffe3-5b90-4b14-b35c-797d2ab91e4d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:31.873620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1ffe3-5b90-4b14-b35c-797d2ab91e4d None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:31.875212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 79/158] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:31.880607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a29ffb-5c4f-4434-8fd9-76090cea0e06 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:31.880968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a29ffb-5c4f-4434-8fd9-76090cea0e06 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:31.881886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a29ffb-5c4f-4434-8fd9-76090cea0e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:31.914425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-f9a29ffb-5c4f-4434-8fd9-76090cea0e06 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:31.915631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f9a29ffb-5c4f-4434-8fd9-76090cea0e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:31.929773 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce5c26-9e05-45e0-8b0d-cd18aa83adc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:31.930411 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5c26-9e05-45e0-8b0d-cd18aa83adc6 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:31.930694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5c26-9e05-45e0-8b0d-cd18aa83adc6 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:31.930971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5c26-9e05-45e0-8b0d-cd18aa83adc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:31.932461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce5c26-9e05-45e0-8b0d-cd18aa83adc6 None admin] RBAC: Adding query filter params (role.id=23c81c3dc8f743289ecb566849eb8324, scope.project.id=ebb4d7000b48410e8173e1b4a878579a, user.id=7476173827d74a3aac24510fe72e7a53) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:31.937273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce5c26-9e05-45e0-8b0d-cd18aa83adc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:31.939212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce5c26-9e05-45e0-8b0d-cd18aa83adc6 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:31.955745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 80/159] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:31 2022] GET /identity/v3/role_assignments?user.id=7476173827d74a3aac24510fe72e7a53&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:32.047323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 80/160] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:32.461200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b21964-fe5f-4b98-82c1-71faf6bd5aba None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:32.461854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b21964-fe5f-4b98-82c1-71faf6bd5aba None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:32.461854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b21964-fe5f-4b98-82c1-71faf6bd5aba None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:32.463101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 81/161] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:32.479967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39037ab7-5609-4c25-acec-233496809402 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:32.481103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39037ab7-5609-4c25-acec-233496809402 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:32.481103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39037ab7-5609-4c25-acec-233496809402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:32.500429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b21964-fe5f-4b98-82c1-71faf6bd5aba None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:32.505152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-39037ab7-5609-4c25-acec-233496809402 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:32.506338 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-39037ab7-5609-4c25-acec-233496809402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:32.580546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:32.646403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 81/162] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:32.647588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39037ab7-5609-4c25-acec-233496809402 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:32.696076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:32.731371 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b21964-fe5f-4b98-82c1-71faf6bd5aba None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:32.775552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ec57e-fa1a-40da-b81a-821a303ffe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:32.776567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ec57e-fa1a-40da-b81a-821a303ffe4a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:32.777588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ec57e-fa1a-40da-b81a-821a303ffe4a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:32.778056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ec57e-fa1a-40da-b81a-821a303ffe4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:32.791457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ec57e-fa1a-40da-b81a-821a303ffe4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-c76ec57e-fa1a-40da-b81a-821a303ffe4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:32.809391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:32.810340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:32.811131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:32.817835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 82/163] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:36:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:32.845896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ec57e-fa1a-40da-b81a-821a303ffe4a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:32.944606 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39037ab7-5609-4c25-acec-233496809402 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:33.026181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355bd63-589b-4eaf-92ff-50c3530f7e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:33.026762 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355bd63-589b-4eaf-92ff-50c3530f7e3c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:33.027596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355bd63-589b-4eaf-92ff-50c3530f7e3c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:33.027877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355bd63-589b-4eaf-92ff-50c3530f7e3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:33.045958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355bd63-589b-4eaf-92ff-50c3530f7e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-6355bd63-589b-4eaf-92ff-50c3530f7e3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:33.051091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:33.052102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:33.053041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 82/164] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:33.058219 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355bd63-589b-4eaf-92ff-50c3530f7e3c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:33.093533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ec57e-fa1a-40da-b81a-821a303ffe4a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:33.117021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:33.203936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322d420-1255-4b37-9aaf-fa49d8e156fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:33.204596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322d420-1255-4b37-9aaf-fa49d8e156fd None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:33.204883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322d420-1255-4b37-9aaf-fa49d8e156fd None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:33.205158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322d420-1255-4b37-9aaf-fa49d8e156fd None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:33.206008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322d420-1255-4b37-9aaf-fa49d8e156fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:33.206278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322d420-1255-4b37-9aaf-fa49d8e156fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:33.208023 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322d420-1255-4b37-9aaf-fa49d8e156fd None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:33.235848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 83/165] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:36:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:33.242564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322d420-1255-4b37-9aaf-fa49d8e156fd None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:33.251546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355bd63-589b-4eaf-92ff-50c3530f7e3c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:33.254964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:33.310225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2fa8-5e90-498f-a18c-babbe51f575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:33.310989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2fa8-5e90-498f-a18c-babbe51f575a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:33.311654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2fa8-5e90-498f-a18c-babbe51f575a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:33.311936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2fa8-5e90-498f-a18c-babbe51f575a None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:33.312636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb2fa8-5e90-498f-a18c-babbe51f575a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:33.312944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb2fa8-5e90-498f-a18c-babbe51f575a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:33.315171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb2fa8-5e90-498f-a18c-babbe51f575a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:33.332719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 83/166] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:33.337947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2fa8-5e90-498f-a18c-babbe51f575a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:33.499503 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322d420-1255-4b37-9aaf-fa49d8e156fd None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:33.561887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:33.568695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2fa8-5e90-498f-a18c-babbe51f575a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:33.581497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028e400-d0ac-4b16-b962-af76e1d7124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:33.581497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028e400-d0ac-4b16-b962-af76e1d7124b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:33.581497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028e400-d0ac-4b16-b962-af76e1d7124b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:33.581497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028e400-d0ac-4b16-b962-af76e1d7124b None admin] PATH_INFO: `/v3/users/7476173827d74a3aac24510fe72e7a53` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:33.586260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028e400-d0ac-4b16-b962-af76e1d7124b None admin] RBAC: Authorizing `identity:get_user(user_id=7476173827d74a3aac24510fe72e7a53)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:33.587947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028e400-d0ac-4b16-b962-af76e1d7124b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:33.594837 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 84/167] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:33 2022] GET /identity/v3/users/7476173827d74a3aac24510fe72e7a53 => generated 275 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:33.595849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028e400-d0ac-4b16-b962-af76e1d7124b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:33.650345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccafb9-91d0-4ec7-9ad1-1203435e93cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:33.650980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccafb9-91d0-4ec7-9ad1-1203435e93cb None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:33.651255 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccafb9-91d0-4ec7-9ad1-1203435e93cb None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:33.651522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccafb9-91d0-4ec7-9ad1-1203435e93cb None admin] PATH_INFO: `/v3/users/b59293d8226b4fba854dac5ea94dd380` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:33.653349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccafb9-91d0-4ec7-9ad1-1203435e93cb None admin] RBAC: Authorizing `identity:get_user(user_id=b59293d8226b4fba854dac5ea94dd380)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:33.654922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccafb9-91d0-4ec7-9ad1-1203435e93cb None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:33.657734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 84/168] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:33 2022] GET /identity/v3/users/b59293d8226b4fba854dac5ea94dd380 => generated 247 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:33.658513 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccafb9-91d0-4ec7-9ad1-1203435e93cb None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:33.724896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:33.782381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028e400-d0ac-4b16-b962-af76e1d7124b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:33.842384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43288def-a18d-4129-b4de-1ec7f0ab3e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:33.844300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43288def-a18d-4129-b4de-1ec7f0ab3e7d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:33.844978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43288def-a18d-4129-b4de-1ec7f0ab3e7d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:33.846347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43288def-a18d-4129-b4de-1ec7f0ab3e7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:33.849772 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccafb9-91d0-4ec7-9ad1-1203435e93cb None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:33.870109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43288def-a18d-4129-b4de-1ec7f0ab3e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-43288def-a18d-4129-b4de-1ec7f0ab3e7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:33.876220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:33.877207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:33.878004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:33.884935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 85/169] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:33.887443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f46a-de27-4d11-a763-c92e92603faf None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:33.890014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f46a-de27-4d11-a763-c92e92603faf None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:33.890439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f46a-de27-4d11-a763-c92e92603faf None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:33.894550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 86/170] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:33.895720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2f46a-de27-4d11-a763-c92e92603faf None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:33.924187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ac6ea-5a6c-49f6-b755-ede68a969660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:33.925081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ac6ea-5a6c-49f6-b755-ede68a969660 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:33.925498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ac6ea-5a6c-49f6-b755-ede68a969660 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:33.925929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ac6ea-5a6c-49f6-b755-ede68a969660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:33.991478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:34.029934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ac6ea-5a6c-49f6-b755-ede68a969660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:34.031423 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ac6ea-5a6c-49f6-b755-ede68a969660 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:34.079968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2f46a-de27-4d11-a763-c92e92603faf None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:34.114101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:34.119317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cdcec-ce79-4cd4-adc8-a3f08e1cd56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:34.120005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cdcec-ce79-4cd4-adc8-a3f08e1cd56d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.120287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cdcec-ce79-4cd4-adc8-a3f08e1cd56d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.120580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cdcec-ce79-4cd4-adc8-a3f08e1cd56d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.162016 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 85/171] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:34.163369 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ac6ea-5a6c-49f6-b755-ede68a969660 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:34.205958 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cdcec-ce79-4cd4-adc8-a3f08e1cd56d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:34.207457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cdcec-ce79-4cd4-adc8-a3f08e1cd56d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:34.248971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:34.275057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ac6ea-5a6c-49f6-b755-ede68a969660 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:34.315132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60660a3d-c573-404d-90fd-68bcafdd4836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:34.315815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60660a3d-c573-404d-90fd-68bcafdd4836 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.316094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60660a3d-c573-404d-90fd-68bcafdd4836 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.316417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60660a3d-c573-404d-90fd-68bcafdd4836 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.317112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60660a3d-c573-404d-90fd-68bcafdd4836 None admin] RBAC: Adding query filter params (name=member) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:34.317415 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60660a3d-c573-404d-90fd-68bcafdd4836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:34.318797 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60660a3d-c573-404d-90fd-68bcafdd4836 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:34.322973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 87/172] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:34.324307 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77053d6-8750-4990-8e82-e70a1167c246 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.324695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77053d6-8750-4990-8e82-e70a1167c246 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.324976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77053d6-8750-4990-8e82-e70a1167c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.330973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 86/173] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:34.332262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2807b-fd66-4baa-841b-0310b48e796a None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.332609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2807b-fd66-4baa-841b-0310b48e796a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.332857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2807b-fd66-4baa-841b-0310b48e796a None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.334256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 87/174] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:34.337320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2807b-fd66-4baa-841b-0310b48e796a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:34.348973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a77053d6-8750-4990-8e82-e70a1167c246 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:34.350602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a77053d6-8750-4990-8e82-e70a1167c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:34.381683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:34.426573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 88/175] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:34.429468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ac83-151f-4489-9257-7ba55be15ffd None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.429767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ac83-151f-4489-9257-7ba55be15ffd None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.430046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ac83-151f-4489-9257-7ba55be15ffd None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.431938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 89/176] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:34.434056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9ac83-151f-4489-9257-7ba55be15ffd None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:34.455943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2807b-fd66-4baa-841b-0310b48e796a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:34.489344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:34.499660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57695c-b289-4897-8742-632cc135de48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:34.500309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57695c-b289-4897-8742-632cc135de48 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.501087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57695c-b289-4897-8742-632cc135de48 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.501087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57695c-b289-4897-8742-632cc135de48 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.502051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57695c-b289-4897-8742-632cc135de48 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:34.503500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57695c-b289-4897-8742-632cc135de48 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:34.505337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 88/177] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:34 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:34.506014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57695c-b289-4897-8742-632cc135de48 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:34.565457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9ac83-151f-4489-9257-7ba55be15ffd None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:34.606127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e4343-8b0a-425b-8582-d58a4199389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:34.606768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4343-8b0a-425b-8582-d58a4199389b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.607048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4343-8b0a-425b-8582-d58a4199389b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.607320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4343-8b0a-425b-8582-d58a4199389b None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.608458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e4343-8b0a-425b-8582-d58a4199389b None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:34.609946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e4343-8b0a-425b-8582-d58a4199389b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:34.611842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 90/178] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:34 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:34.617579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4bfd3-ca8e-4550-bed3-5211e5ebc852 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.617842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4bfd3-ca8e-4550-bed3-5211e5ebc852 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.618118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4bfd3-ca8e-4550-bed3-5211e5ebc852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.624021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57695c-b289-4897-8742-632cc135de48 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:34.638130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8be4bfd3-ca8e-4550-bed3-5211e5ebc852 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:34.639260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8be4bfd3-ca8e-4550-bed3-5211e5ebc852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:34.669351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:34.672066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ac9de-9acc-4e58-8c1f-c6f60823f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:34.672768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ac9de-9acc-4e58-8c1f-c6f60823f25d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.673048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ac9de-9acc-4e58-8c1f-c6f60823f25d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.673320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ac9de-9acc-4e58-8c1f-c6f60823f25d None admin] PATH_INFO: `/v3/users/7476173827d74a3aac24510fe72e7a53` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.674750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ac9de-9acc-4e58-8c1f-c6f60823f25d None admin] RBAC: Authorizing `identity:get_user(user_id=7476173827d74a3aac24510fe72e7a53)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:34.676428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ac9de-9acc-4e58-8c1f-c6f60823f25d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:34.682880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 89/179] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:34 2022] GET /identity/v3/users/7476173827d74a3aac24510fe72e7a53 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:34.682880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e33883-056d-4dba-8b71-ed60750eb3c1 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.682880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e33883-056d-4dba-8b71-ed60750eb3c1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.682880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e33883-056d-4dba-8b71-ed60750eb3c1 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.682880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 90/180] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:34.682880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840c91-a5e3-48b9-b692-f7aa5e3b3bf2 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.697189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840c91-a5e3-48b9-b692-f7aa5e3b3bf2 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.697189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a840c91-a5e3-48b9-b692-f7aa5e3b3bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.724845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-1a840c91-a5e3-48b9-b692-f7aa5e3b3bf2 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:34.726242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1a840c91-a5e3-48b9-b692-f7aa5e3b3bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:34.729036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 91/181] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:34.729791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4bfd3-ca8e-4550-bed3-5211e5ebc852 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:34.801083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:34.811116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 91/182] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:34.812614 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a840c91-a5e3-48b9-b692-f7aa5e3b3bf2 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:34.857921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4bfd3-ca8e-4550-bed3-5211e5ebc852 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:34.897291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252350f-524f-43cc-87c0-e1c6c06e0a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:34.898177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252350f-524f-43cc-87c0-e1c6c06e0a10 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:34.898558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252350f-524f-43cc-87c0-e1c6c06e0a10 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:34.898938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252350f-524f-43cc-87c0-e1c6c06e0a10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:34.899851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252350f-524f-43cc-87c0-e1c6c06e0a10 None admin] RBAC: Adding query filter params (role.id=e5562064df7e4f1a96a35d581b4f28c4, scope.project.id=ebb4d7000b48410e8173e1b4a878579a, user.id=7476173827d74a3aac24510fe72e7a53) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:34.900314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252350f-524f-43cc-87c0-e1c6c06e0a10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:34.902061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252350f-524f-43cc-87c0-e1c6c06e0a10 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:34.908766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 92/183] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:34 2022] GET /identity/v3/role_assignments?user.id=7476173827d74a3aac24510fe72e7a53&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=e5562064df7e4f1a96a35d581b4f28c4 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:34.913681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252350f-524f-43cc-87c0-e1c6c06e0a10 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:34.983468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:35.070905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a840c91-a5e3-48b9-b692-f7aa5e3b3bf2 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:35.138680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb3742-28dd-4e89-9580-33f6403afe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:35.139335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb3742-28dd-4e89-9580-33f6403afe3f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:35.139618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb3742-28dd-4e89-9580-33f6403afe3f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:35.139893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb3742-28dd-4e89-9580-33f6403afe3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:35.140771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb3742-28dd-4e89-9580-33f6403afe3f None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=ebb4d7000b48410e8173e1b4a878579a, user.id=b59293d8226b4fba854dac5ea94dd380) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:35.141088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb3742-28dd-4e89-9580-33f6403afe3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:35.142763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb3742-28dd-4e89-9580-33f6403afe3f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:35.149824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252350f-524f-43cc-87c0-e1c6c06e0a10 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:35.149976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 92/184] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:34 2022] GET /identity/v3/role_assignments?user.id=b59293d8226b4fba854dac5ea94dd380&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=eeb6551eeb934053866fc821b511b5dd => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:35.155140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee34e-0627-42cd-87e4-7aa4ecf7b014 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:35.155140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee34e-0627-42cd-87e4-7aa4ecf7b014 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:35.155140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee34e-0627-42cd-87e4-7aa4ecf7b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:35.194825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d0cee34e-0627-42cd-87e4-7aa4ecf7b014 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:35.196659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d0cee34e-0627-42cd-87e4-7aa4ecf7b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:35.211647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53629a-8b53-48dd-a41c-0ee2d87db7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:35.212155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53629a-8b53-48dd-a41c-0ee2d87db7e7 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:35.212431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53629a-8b53-48dd-a41c-0ee2d87db7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:35.213230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53629a-8b53-48dd-a41c-0ee2d87db7e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:35.278302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:35.296223 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53629a-8b53-48dd-a41c-0ee2d87db7e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:35.297465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 93/185] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:35.297948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53629a-8b53-48dd-a41c-0ee2d87db7e7 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:35.298137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cee34e-0627-42cd-87e4-7aa4ecf7b014 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:35.329679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:35.436575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 93/186] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:35.437420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53629a-8b53-48dd-a41c-0ee2d87db7e7 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:35.451056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cee34e-0627-42cd-87e4-7aa4ecf7b014 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:35.489258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ddbb8-328d-4aa9-8d36-f433fd1f21b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:35.489903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ddbb8-328d-4aa9-8d36-f433fd1f21b1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:35.490186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ddbb8-328d-4aa9-8d36-f433fd1f21b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:35.490455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ddbb8-328d-4aa9-8d36-f433fd1f21b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:35.502531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ddbb8-328d-4aa9-8d36-f433fd1f21b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-362ddbb8-328d-4aa9-8d36-f433fd1f21b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:35.507248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:35.508178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 94/187] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:36:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:35.509894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ddbb8-328d-4aa9-8d36-f433fd1f21b1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:35.558584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53629a-8b53-48dd-a41c-0ee2d87db7e7 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:35.566261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:35.587004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:35.598376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b838a2-8fc6-485a-9f29-0a770a5ca303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:35.599058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b838a2-8fc6-485a-9f29-0a770a5ca303 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:35.599348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b838a2-8fc6-485a-9f29-0a770a5ca303 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:35.599646 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b838a2-8fc6-485a-9f29-0a770a5ca303 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:35.600787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b838a2-8fc6-485a-9f29-0a770a5ca303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:35.602249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b838a2-8fc6-485a-9f29-0a770a5ca303 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:35.603817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 94/188] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:35.604595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b838a2-8fc6-485a-9f29-0a770a5ca303 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:35.620698 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ddbb8-328d-4aa9-8d36-f433fd1f21b1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:35.657985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b369-340c-4000-a61e-71e03ba439fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:35.658676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b369-340c-4000-a61e-71e03ba439fc None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:35.658970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b369-340c-4000-a61e-71e03ba439fc None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:35.659244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b369-340c-4000-a61e-71e03ba439fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:35.669581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398b369-340c-4000-a61e-71e03ba439fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-d398b369-340c-4000-a61e-71e03ba439fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:35.674749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:35.675676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:35.676639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 95/189] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:36:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:35.679916 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b369-340c-4000-a61e-71e03ba439fc None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:35.708220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b838a2-8fc6-485a-9f29-0a770a5ca303 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:35.742424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5941265-212a-4e6b-90ff-b6e957e465df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:35.743057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5941265-212a-4e6b-90ff-b6e957e465df None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:35.743399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5941265-212a-4e6b-90ff-b6e957e465df None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:35.743681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5941265-212a-4e6b-90ff-b6e957e465df None admin] PATH_INFO: `/v3/projects/d2792053c34d4adc8aa7fbd4ac5534ba` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:35.744861 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5941265-212a-4e6b-90ff-b6e957e465df None admin] RBAC: Authorizing `identity:get_project(project_id=d2792053c34d4adc8aa7fbd4ac5534ba)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:35.746905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5941265-212a-4e6b-90ff-b6e957e465df None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:35.748553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 95/190] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:35 2022] GET /identity/v3/projects/d2792053c34d4adc8aa7fbd4ac5534ba => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:35.749328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5941265-212a-4e6b-90ff-b6e957e465df None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:35.779930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b369-340c-4000-a61e-71e03ba439fc None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:35.789092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:35.807859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:35.817830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838b3b6-4252-403e-8cdc-a50b8ee91f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:35.818441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838b3b6-4252-403e-8cdc-a50b8ee91f0a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:35.818720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838b3b6-4252-403e-8cdc-a50b8ee91f0a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:35.818993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838b3b6-4252-403e-8cdc-a50b8ee91f0a None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:35.819654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838b3b6-4252-403e-8cdc-a50b8ee91f0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:35.819956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838b3b6-4252-403e-8cdc-a50b8ee91f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:35.821389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838b3b6-4252-403e-8cdc-a50b8ee91f0a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:35.829960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 96/191] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:35.830764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838b3b6-4252-403e-8cdc-a50b8ee91f0a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:35.849588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5941265-212a-4e6b-90ff-b6e957e465df None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:35.883142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726eb1d-9a2e-4e57-914c-2c98e1d982ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:35.883848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726eb1d-9a2e-4e57-914c-2c98e1d982ff None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:35.884131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726eb1d-9a2e-4e57-914c-2c98e1d982ff None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:35.884402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726eb1d-9a2e-4e57-914c-2c98e1d982ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:35.894931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726eb1d-9a2e-4e57-914c-2c98e1d982ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-5726eb1d-9a2e-4e57-914c-2c98e1d982ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:35.900116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:35.901251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:35.902072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 96/192] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:35.902830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726eb1d-9a2e-4e57-914c-2c98e1d982ff None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:35.939739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838b3b6-4252-403e-8cdc-a50b8ee91f0a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:35.975160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd65369-7ece-4db4-ad86-2fb054e2dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:35.975803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd65369-7ece-4db4-ad86-2fb054e2dca0 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:35.976090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd65369-7ece-4db4-ad86-2fb054e2dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:35.976397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd65369-7ece-4db4-ad86-2fb054e2dca0 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:35.977124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd65369-7ece-4db4-ad86-2fb054e2dca0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:35.978646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd65369-7ece-4db4-ad86-2fb054e2dca0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:36.005042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726eb1d-9a2e-4e57-914c-2c98e1d982ff None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:36.027001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:36.041948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef183111-945c-4056-bff0-db845a1766a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:36.043041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef183111-945c-4056-bff0-db845a1766a5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:36.043315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef183111-945c-4056-bff0-db845a1766a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:36.043589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef183111-945c-4056-bff0-db845a1766a5 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:36.044252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef183111-945c-4056-bff0-db845a1766a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:36.044795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef183111-945c-4056-bff0-db845a1766a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:36.046888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef183111-945c-4056-bff0-db845a1766a5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:36.056120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 97/193] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:36:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:36.056921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef183111-945c-4056-bff0-db845a1766a5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:36.083610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 97/194] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:36:35 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:36.083610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd65369-7ece-4db4-ad86-2fb054e2dca0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:36.114147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:36.201672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd65369-7ece-4db4-ad86-2fb054e2dca0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:36.212869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef183111-945c-4056-bff0-db845a1766a5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:36.259609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d0b0-d653-4709-9f75-e4c44936169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:36.259910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90340a-4e63-4ad9-90d4-a4923a3020dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:36.260576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90340a-4e63-4ad9-90d4-a4923a3020dc None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:36.261000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90340a-4e63-4ad9-90d4-a4923a3020dc None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:36.261341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90340a-4e63-4ad9-90d4-a4923a3020dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:36.261769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d0b0-d653-4709-9f75-e4c44936169e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:36.262189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d0b0-d653-4709-9f75-e4c44936169e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:36.262518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90340a-4e63-4ad9-90d4-a4923a3020dc None admin] RBAC: Adding query filter params (role.id=23c81c3dc8f743289ecb566849eb8324, scope.project.id=d2792053c34d4adc8aa7fbd4ac5534ba, user.id=7476173827d74a3aac24510fe72e7a53) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:36.262770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d0b0-d653-4709-9f75-e4c44936169e None admin] PATH_INFO: `/v3/users/4ff582f3a88d4aa9b007b0072e26e770` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:36.263196 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90340a-4e63-4ad9-90d4-a4923a3020dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:36.266083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90340a-4e63-4ad9-90d4-a4923a3020dc None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:36.277834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 98/195] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:36 2022] GET /identity/v3/role_assignments?user.id=7476173827d74a3aac24510fe72e7a53&scope.project.id=d2792053c34d4adc8aa7fbd4ac5534ba&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:36.278615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90340a-4e63-4ad9-90d4-a4923a3020dc None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:36.279465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409d0b0-d653-4709-9f75-e4c44936169e None admin] RBAC: Authorizing `identity:get_user(user_id=4ff582f3a88d4aa9b007b0072e26e770)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:36.281108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409d0b0-d653-4709-9f75-e4c44936169e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:36.283973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 98/196] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:36 2022] GET /identity/v3/users/4ff582f3a88d4aa9b007b0072e26e770 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:36.285332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d0b0-d653-4709-9f75-e4c44936169e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:36.364074 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:36.445677 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90340a-4e63-4ad9-90d4-a4923a3020dc None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:36.460634 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:36.486782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b6d62-686f-409e-8622-1ab50c3070da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:36.487678 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b6d62-686f-409e-8622-1ab50c3070da None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:36.487678 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b6d62-686f-409e-8622-1ab50c3070da None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:36.488540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b6d62-686f-409e-8622-1ab50c3070da None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:36.488621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b6d62-686f-409e-8622-1ab50c3070da None admin] RBAC: Adding query filter params (name=reader) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:36.488914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b6d62-686f-409e-8622-1ab50c3070da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:36.490296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b6d62-686f-409e-8622-1ab50c3070da None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:36.490721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d0b0-d653-4709-9f75-e4c44936169e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:36.500992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 99/197] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:36.501849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b6d62-686f-409e-8622-1ab50c3070da None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:36.549573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6f703-5ada-4ccc-a0ea-296a0027f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:36.550143 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6f703-5ada-4ccc-a0ea-296a0027f666 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:36.550420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6f703-5ada-4ccc-a0ea-296a0027f666 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:36.550690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6f703-5ada-4ccc-a0ea-296a0027f666 None admin] PATH_INFO: `/v3/users/4ff582f3a88d4aa9b007b0072e26e770` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:36.552925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6f703-5ada-4ccc-a0ea-296a0027f666 None admin] RBAC: Authorizing `identity:get_user(user_id=4ff582f3a88d4aa9b007b0072e26e770)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:36.554386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6f703-5ada-4ccc-a0ea-296a0027f666 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:36.556302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 99/198] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:36 2022] GET /identity/v3/users/4ff582f3a88d4aa9b007b0072e26e770 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:36.557113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6f703-5ada-4ccc-a0ea-296a0027f666 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:36.689443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b6d62-686f-409e-8622-1ab50c3070da None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:36.700188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6f703-5ada-4ccc-a0ea-296a0027f666 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:36.711518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:36.744997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ecd4-64b3-4746-a5c7-53f70a6892a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:36.745801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ecd4-64b3-4746-a5c7-53f70a6892a4 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:36.746230 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ecd4-64b3-4746-a5c7-53f70a6892a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:36.746574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440ecd4-64b3-4746-a5c7-53f70a6892a4 None admin] PATH_INFO: `/v3/users/140476a9ae5e42a0a5160d4d1cac85e7` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:36.747823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440ecd4-64b3-4746-a5c7-53f70a6892a4 None admin] RBAC: Authorizing `identity:get_user(user_id=140476a9ae5e42a0a5160d4d1cac85e7)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:36.749433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440ecd4-64b3-4746-a5c7-53f70a6892a4 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:36.751454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 100/199] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:36 2022] GET /identity/v3/users/140476a9ae5e42a0a5160d4d1cac85e7 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:36.752336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ecd4-64b3-4746-a5c7-53f70a6892a4 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:36.762214 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b26e52-f61f-49ae-a3d9-44464353571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:36.762829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26e52-f61f-49ae-a3d9-44464353571a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:36.763104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26e52-f61f-49ae-a3d9-44464353571a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:36.763360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26e52-f61f-49ae-a3d9-44464353571a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:36.813021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:36.885001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440ecd4-64b3-4746-a5c7-53f70a6892a4 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:36.903415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b26e52-f61f-49ae-a3d9-44464353571a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:36.905404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b26e52-f61f-49ae-a3d9-44464353571a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:36.922679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a038c57-af49-4b43-a07b-df172c52ca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:36.923337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038c57-af49-4b43-a07b-df172c52ca3f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:36.923874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038c57-af49-4b43-a07b-df172c52ca3f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:36.924160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038c57-af49-4b43-a07b-df172c52ca3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:36.999246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a038c57-af49-4b43-a07b-df172c52ca3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:37.001203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a038c57-af49-4b43-a07b-df172c52ca3f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:37.021855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 100/200] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:37.023191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b26e52-f61f-49ae-a3d9-44464353571a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:37.024241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:37.035756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:37.132337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b26e52-f61f-49ae-a3d9-44464353571a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:37.133603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 101/201] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:37.142533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a038c57-af49-4b43-a07b-df172c52ca3f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:37.172141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0808-c02e-419d-843b-d97e95dda701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:37.173128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0808-c02e-419d-843b-d97e95dda701 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:37.173845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0808-c02e-419d-843b-d97e95dda701 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:37.174317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0808-c02e-419d-843b-d97e95dda701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:37.257168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0808-c02e-419d-843b-d97e95dda701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:37.259014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0808-c02e-419d-843b-d97e95dda701 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:37.266159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a038c57-af49-4b43-a07b-df172c52ca3f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:37.270384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:37.288255 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:37.303143 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506f48-a835-4231-9ace-ae9faab83398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:37.306001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506f48-a835-4231-9ace-ae9faab83398 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:37.306484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506f48-a835-4231-9ace-ae9faab83398 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:37.306923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506f48-a835-4231-9ace-ae9faab83398 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:37.310335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506f48-a835-4231-9ace-ae9faab83398 None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:37.311296 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506f48-a835-4231-9ace-ae9faab83398 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:37.313531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 102/202] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:37 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:37.314411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506f48-a835-4231-9ace-ae9faab83398 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:37.374394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 101/203] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:37.375667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0808-c02e-419d-843b-d97e95dda701 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:37.461263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506f48-a835-4231-9ace-ae9faab83398 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:37.502785 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a1f23-d75c-4008-8c24-c8955ea1e9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:37.503439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a1f23-d75c-4008-8c24-c8955ea1e9ee None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:37.503720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a1f23-d75c-4008-8c24-c8955ea1e9ee None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:37.503988 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a1f23-d75c-4008-8c24-c8955ea1e9ee None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:37.505186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a1f23-d75c-4008-8c24-c8955ea1e9ee None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:37.506731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a1f23-d75c-4008-8c24-c8955ea1e9ee None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:37.508674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 103/204] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:37 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:37.510553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a1f23-d75c-4008-8c24-c8955ea1e9ee None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:37.557927 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0808-c02e-419d-843b-d97e95dda701 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:37.570682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:37.587199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:37.609352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea27e6f-3e26-4ed7-9886-e7206f7733dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:37.609984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea27e6f-3e26-4ed7-9886-e7206f7733dc None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:37.610310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea27e6f-3e26-4ed7-9886-e7206f7733dc None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:37.610578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea27e6f-3e26-4ed7-9886-e7206f7733dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:37.611312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea27e6f-3e26-4ed7-9886-e7206f7733dc None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b, user.id=4ff582f3a88d4aa9b007b0072e26e770) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:37.611615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea27e6f-3e26-4ed7-9886-e7206f7733dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:37.613119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea27e6f-3e26-4ed7-9886-e7206f7733dc None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:37.619673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 102/205] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:37 2022] GET /identity/v3/role_assignments?user.id=4ff582f3a88d4aa9b007b0072e26e770&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=eeb6551eeb934053866fc821b511b5dd => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:37.619673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea27e6f-3e26-4ed7-9886-e7206f7733dc None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:37.670764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a1f23-d75c-4008-8c24-c8955ea1e9ee None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:37.745143 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d270721-a11f-4a7d-b51e-4bc20452ff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:37.745820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d270721-a11f-4a7d-b51e-4bc20452ff83 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:37.746092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d270721-a11f-4a7d-b51e-4bc20452ff83 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:37.746363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d270721-a11f-4a7d-b51e-4bc20452ff83 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:37.749497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d270721-a11f-4a7d-b51e-4bc20452ff83 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:37.753090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d270721-a11f-4a7d-b51e-4bc20452ff83 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:37.754993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 104/206] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:37 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:37.762829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d270721-a11f-4a7d-b51e-4bc20452ff83 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:37.856692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea27e6f-3e26-4ed7-9886-e7206f7733dc None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:37.939145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db28fe-6fc2-4a0a-b851-080b8c4db1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:37.940141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db28fe-6fc2-4a0a-b851-080b8c4db1e5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:37.940627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db28fe-6fc2-4a0a-b851-080b8c4db1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:37.941137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db28fe-6fc2-4a0a-b851-080b8c4db1e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:37.942417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db28fe-6fc2-4a0a-b851-080b8c4db1e5 None admin] RBAC: Adding query filter params (role.id=e5562064df7e4f1a96a35d581b4f28c4, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b, user.id=4ff582f3a88d4aa9b007b0072e26e770) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:37.942925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db28fe-6fc2-4a0a-b851-080b8c4db1e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:37.952557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db28fe-6fc2-4a0a-b851-080b8c4db1e5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:37.974211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 103/207] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:37 2022] GET /identity/v3/role_assignments?user.id=4ff582f3a88d4aa9b007b0072e26e770&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=e5562064df7e4f1a96a35d581b4f28c4 => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:38.035931 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d270721-a11f-4a7d-b51e-4bc20452ff83 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:38.082953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:38.103738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a31d9-d199-48d4-aff0-9ab81f5101c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:38.105850 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a31d9-d199-48d4-aff0-9ab81f5101c4 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:38.106609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a31d9-d199-48d4-aff0-9ab81f5101c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:38.107350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a31d9-d199-48d4-aff0-9ab81f5101c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:38.108924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a31d9-d199-48d4-aff0-9ab81f5101c4 None admin] RBAC: Adding query filter params (role.id=0be962a218de4ebd87c3062a16459c98, scope.project.id=ebb4d7000b48410e8173e1b4a878579a, user.id=140476a9ae5e42a0a5160d4d1cac85e7) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:38.109712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a31d9-d199-48d4-aff0-9ab81f5101c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:38.112408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a31d9-d199-48d4-aff0-9ab81f5101c4 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:38.128980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 105/208] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:37 2022] GET /identity/v3/role_assignments?user.id=140476a9ae5e42a0a5160d4d1cac85e7&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=0be962a218de4ebd87c3062a16459c98 => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:38.826524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619468f0-f37c-4756-859f-bce9d04614c6 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:38.826928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619468f0-f37c-4756-859f-bce9d04614c6 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:38.827108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619468f0-f37c-4756-859f-bce9d04614c6 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:38.828618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 104/209] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:38.834328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bdf7-28c3-44f3-b8d3-944c48112b5f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:38.834888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bdf7-28c3-44f3-b8d3-944c48112b5f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:38.834888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bdf7-28c3-44f3-b8d3-944c48112b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:38.856278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-7e53bdf7-28c3-44f3-b8d3-944c48112b5f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:38.857907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7e53bdf7-28c3-44f3-b8d3-944c48112b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:38.937344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 106/210] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:39.008495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bafc8-1ec2-4174-9d9a-6f7062f356fa None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:39.009072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bafc8-1ec2-4174-9d9a-6f7062f356fa None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:39.009146 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bafc8-1ec2-4174-9d9a-6f7062f356fa None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:39.010897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 105/211] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:39.017133 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5709f-527d-4076-bf88-08002c1497b8 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:39.017679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5709f-527d-4076-bf88-08002c1497b8 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:39.018124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5709f-527d-4076-bf88-08002c1497b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:39.037312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c7e5709f-527d-4076-bf88-08002c1497b8 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:39.038783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c7e5709f-527d-4076-bf88-08002c1497b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:39.110145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 107/212] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:39.245323 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bafc8-1ec2-4174-9d9a-6f7062f356fa None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:39.286006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:39.359776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bafc8-1ec2-4174-9d9a-6f7062f356fa None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:39.377098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5709f-527d-4076-bf88-08002c1497b8 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:39.399611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9225-d5ea-40a5-9136-964df3a0d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:39.400358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9225-d5ea-40a5-9136-964df3a0d36d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:39.400669 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9225-d5ea-40a5-9136-964df3a0d36d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:39.400941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9225-d5ea-40a5-9136-964df3a0d36d None admin] PATH_INFO: `/v3/roles/member` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:39.414107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba9225-d5ea-40a5-9136-964df3a0d36d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-46ba9225-d5ea-40a5-9136-964df3a0d36d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:39.419295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:39.420185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:39.421041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 106/213] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:39.429045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9225-d5ea-40a5-9136-964df3a0d36d None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:39.432222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:39.503436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5709f-527d-4076-bf88-08002c1497b8 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:39.549478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10f5b4-0142-49d0-ac1d-8e38a948923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:39.550257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10f5b4-0142-49d0-ac1d-8e38a948923a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:39.550626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10f5b4-0142-49d0-ac1d-8e38a948923a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:39.550982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10f5b4-0142-49d0-ac1d-8e38a948923a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:39.552231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10f5b4-0142-49d0-ac1d-8e38a948923a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:39.553893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10f5b4-0142-49d0-ac1d-8e38a948923a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:39.556482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 108/214] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:39.567911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10f5b4-0142-49d0-ac1d-8e38a948923a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:39.583974 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:39.591056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9225-d5ea-40a5-9136-964df3a0d36d None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:39.631508 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61fd0f-a701-4ee5-8dda-fd6cb904a6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:39.632042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61fd0f-a701-4ee5-8dda-fd6cb904a6c8 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:39.632317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61fd0f-a701-4ee5-8dda-fd6cb904a6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:39.632612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61fd0f-a701-4ee5-8dda-fd6cb904a6c8 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:39.633286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61fd0f-a701-4ee5-8dda-fd6cb904a6c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:39.633597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61fd0f-a701-4ee5-8dda-fd6cb904a6c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:39.634995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61fd0f-a701-4ee5-8dda-fd6cb904a6c8 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:39.648612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 107/215] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:39.655315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61fd0f-a701-4ee5-8dda-fd6cb904a6c8 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:39.710307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10f5b4-0142-49d0-ac1d-8e38a948923a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:39.733628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:39.752288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306abea-6038-4349-a757-e90ce911236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:39.752952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306abea-6038-4349-a757-e90ce911236f None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:39.753233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306abea-6038-4349-a757-e90ce911236f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:39.753502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306abea-6038-4349-a757-e90ce911236f None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:39.754149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306abea-6038-4349-a757-e90ce911236f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:39.755736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306abea-6038-4349-a757-e90ce911236f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:39.791673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61fd0f-a701-4ee5-8dda-fd6cb904a6c8 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:39.833368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3bb72-0d0b-48ca-a495-fbc795baf5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:39.834324 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3bb72-0d0b-48ca-a495-fbc795baf5ef None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:39.834839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3bb72-0d0b-48ca-a495-fbc795baf5ef None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:39.835350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3bb72-0d0b-48ca-a495-fbc795baf5ef None admin] PATH_INFO: `/v3/users/2bb8ce95c4bb46d18a38e0572743885f` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:39.850999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3bb72-0d0b-48ca-a495-fbc795baf5ef None admin] RBAC: Authorizing `identity:get_user(user_id=2bb8ce95c4bb46d18a38e0572743885f)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:39.852820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3bb72-0d0b-48ca-a495-fbc795baf5ef None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:39.854663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 108/216] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:39 2022] GET /identity/v3/users/2bb8ce95c4bb46d18a38e0572743885f => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:39.861209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3bb72-0d0b-48ca-a495-fbc795baf5ef None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:39.867313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 109/217] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:36:39 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:39.884708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:39.996366 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3bb72-0d0b-48ca-a495-fbc795baf5ef None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:40.045659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8e52e-3e47-4aff-a72c-69c387f9020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:40.047457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8e52e-3e47-4aff-a72c-69c387f9020e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:40.047914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8e52e-3e47-4aff-a72c-69c387f9020e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:40.048360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8e52e-3e47-4aff-a72c-69c387f9020e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:40.135492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8e52e-3e47-4aff-a72c-69c387f9020e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:40.137998 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8e52e-3e47-4aff-a72c-69c387f9020e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:40.157664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:40.249945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9e86-b7bb-4c5b-aa5e-d36b804cacad None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:40.250391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9e86-b7bb-4c5b-aa5e-d36b804cacad None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:40.250669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa9e86-b7bb-4c5b-aa5e-d36b804cacad None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:40.252039 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 110/218] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:36:40.259278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a1b16-ae77-4ed1-9369-d7f085e2b419 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:40.259572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a1b16-ae77-4ed1-9369-d7f085e2b419 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:40.259855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a1b16-ae77-4ed1-9369-d7f085e2b419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:40.263962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 109/219] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 15:36:40.273418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8e52e-3e47-4aff-a72c-69c387f9020e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:40.288211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-1c5a1b16-ae77-4ed1-9369-d7f085e2b419 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:40.289959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1c5a1b16-ae77-4ed1-9369-d7f085e2b419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:40.387588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 111/220] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:40.445895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8e52e-3e47-4aff-a72c-69c387f9020e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:40.464679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:40.489590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fa326-9820-4996-aaad-5a3e8ed8e63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:40.490246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fa326-9820-4996-aaad-5a3e8ed8e63b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:40.490520 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fa326-9820-4996-aaad-5a3e8ed8e63b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:40.490788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fa326-9820-4996-aaad-5a3e8ed8e63b None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:40.491987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fa326-9820-4996-aaad-5a3e8ed8e63b None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:40.493714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fa326-9820-4996-aaad-5a3e8ed8e63b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:40.495423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 110/221] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:40 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:40.502613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a1b16-ae77-4ed1-9369-d7f085e2b419 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:40.657335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23f9bb-4c94-4c50-96af-e0bbb3765fb3 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:40.657566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23f9bb-4c94-4c50-96af-e0bbb3765fb3 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:40.657801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23f9bb-4c94-4c50-96af-e0bbb3765fb3 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:40.659458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 111/222] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:40.665531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d799c7-b9ad-4ed7-92ed-2910b89e87f7 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:40.665835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d799c7-b9ad-4ed7-92ed-2910b89e87f7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:40.666608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d799c7-b9ad-4ed7-92ed-2910b89e87f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:40.689112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a1b16-ae77-4ed1-9369-d7f085e2b419 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:40.693022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:40.706378 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-25d799c7-b9ad-4ed7-92ed-2910b89e87f7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:40.707658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-25d799c7-b9ad-4ed7-92ed-2910b89e87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:40.759191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf6c06-18c8-4ffc-814d-a60f14f50d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:40.759832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf6c06-18c8-4ffc-814d-a60f14f50d46 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:40.760117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf6c06-18c8-4ffc-814d-a60f14f50d46 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:40.760389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf6c06-18c8-4ffc-814d-a60f14f50d46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:40.761804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf6c06-18c8-4ffc-814d-a60f14f50d46 None admin] RBAC: Adding query filter params (role.id=23c81c3dc8f743289ecb566849eb8324, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b, user.id=2bb8ce95c4bb46d18a38e0572743885f) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:40.762113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf6c06-18c8-4ffc-814d-a60f14f50d46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:40.763591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf6c06-18c8-4ffc-814d-a60f14f50d46 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:40.771496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 112/223] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:40 2022] GET /identity/v3/role_assignments?user.id=2bb8ce95c4bb46d18a38e0572743885f&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:40.772615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf6c06-18c8-4ffc-814d-a60f14f50d46 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:40.839746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 112/224] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:40.896529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf6c06-18c8-4ffc-814d-a60f14f50d46 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:40.937983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325ec4d-074f-4586-b593-ada30ee63118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:40.938551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325ec4d-074f-4586-b593-ada30ee63118 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:40.938835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325ec4d-074f-4586-b593-ada30ee63118 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:40.939109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325ec4d-074f-4586-b593-ada30ee63118 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:40.952663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325ec4d-074f-4586-b593-ada30ee63118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-9325ec4d-074f-4586-b593-ada30ee63118 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:40.958185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:40.959193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:40.959989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 113/225] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:36:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:40.971628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d799c7-b9ad-4ed7-92ed-2910b89e87f7 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:41.092198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d799c7-b9ad-4ed7-92ed-2910b89e87f7 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:41.107266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:41.135347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc22e3a-e8ea-4c35-9f8f-99bf65d2642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:41.136006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc22e3a-e8ea-4c35-9f8f-99bf65d2642e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:41.136678 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc22e3a-e8ea-4c35-9f8f-99bf65d2642e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:41.136954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc22e3a-e8ea-4c35-9f8f-99bf65d2642e None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:41.138004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc22e3a-e8ea-4c35-9f8f-99bf65d2642e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:41.138309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc22e3a-e8ea-4c35-9f8f-99bf65d2642e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:41.139795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc22e3a-e8ea-4c35-9f8f-99bf65d2642e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:41.140283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325ec4d-074f-4586-b593-ada30ee63118 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:41.149517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 113/226] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:41.160185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc22e3a-e8ea-4c35-9f8f-99bf65d2642e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:41.177216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:41.289549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc22e3a-e8ea-4c35-9f8f-99bf65d2642e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:41.327022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f81b71-3342-444d-86f9-3e621381a093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:41.327669 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f81b71-3342-444d-86f9-3e621381a093 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:41.327945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f81b71-3342-444d-86f9-3e621381a093 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:41.328209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f81b71-3342-444d-86f9-3e621381a093 None admin] PATH_INFO: `/v3/users/4ff582f3a88d4aa9b007b0072e26e770` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:41.329410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f81b71-3342-444d-86f9-3e621381a093 None admin] RBAC: Authorizing `identity:get_user(user_id=4ff582f3a88d4aa9b007b0072e26e770)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:41.330849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f81b71-3342-444d-86f9-3e621381a093 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:41.332462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 114/227] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:41 2022] GET /identity/v3/users/4ff582f3a88d4aa9b007b0072e26e770 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:41.338309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f81b71-3342-444d-86f9-3e621381a093 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:41.355831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325ec4d-074f-4586-b593-ada30ee63118 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:41.389295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:41.436269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006de73-af9a-4d00-a0f6-f8914dda5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:41.437159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006de73-af9a-4d00-a0f6-f8914dda5516 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:41.437444 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006de73-af9a-4d00-a0f6-f8914dda5516 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:41.437818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006de73-af9a-4d00-a0f6-f8914dda5516 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:41.466808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006de73-af9a-4d00-a0f6-f8914dda5516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-0006de73-af9a-4d00-a0f6-f8914dda5516 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:41.477141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:41.478892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:41.481773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 114/228] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:36:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:41.490560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006de73-af9a-4d00-a0f6-f8914dda5516 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:41.492666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f81b71-3342-444d-86f9-3e621381a093 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:41.564425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e25ba-4ff9-43d1-8492-4a971d8fbecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:41.567044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e25ba-4ff9-43d1-8492-4a971d8fbecc None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:41.568914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e25ba-4ff9-43d1-8492-4a971d8fbecc None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:41.569380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e25ba-4ff9-43d1-8492-4a971d8fbecc None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:41.574476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e25ba-4ff9-43d1-8492-4a971d8fbecc None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:41.576273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e25ba-4ff9-43d1-8492-4a971d8fbecc None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:41.578352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 115/229] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:41 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:41.593966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e25ba-4ff9-43d1-8492-4a971d8fbecc None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:41.693863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:41.717944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006de73-af9a-4d00-a0f6-f8914dda5516 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:41.780009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c2a4a-83d4-4924-8b29-f05ac7422a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:41.780687 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c2a4a-83d4-4924-8b29-f05ac7422a6d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:41.780973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c2a4a-83d4-4924-8b29-f05ac7422a6d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:41.781301 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c2a4a-83d4-4924-8b29-f05ac7422a6d None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:41.781982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c2a4a-83d4-4924-8b29-f05ac7422a6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:41.784538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c2a4a-83d4-4924-8b29-f05ac7422a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:41.784538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c2a4a-83d4-4924-8b29-f05ac7422a6d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:41.794882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 115/230] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:36:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:41.801087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c2a4a-83d4-4924-8b29-f05ac7422a6d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:41.809216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e25ba-4ff9-43d1-8492-4a971d8fbecc None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:41.842299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:41.890062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f97e55-8570-49c5-a40c-34af8b136364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:41.890968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f97e55-8570-49c5-a40c-34af8b136364 None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:41.891386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f97e55-8570-49c5-a40c-34af8b136364 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:41.891795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f97e55-8570-49c5-a40c-34af8b136364 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/users/4ff582f3a88d4aa9b007b0072e26e770/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:41.894250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f97e55-8570-49c5-a40c-34af8b136364 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d0eaf03e66c44178fdd9445fd20713b, user_id=4ff582f3a88d4aa9b007b0072e26e770, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:41.895875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f97e55-8570-49c5-a40c-34af8b136364 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:41.912410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c2a4a-83d4-4924-8b29-f05ac7422a6d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:41.948781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5458db-5729-462c-98ff-1de6e958bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:41.949478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5458db-5729-462c-98ff-1de6e958bae0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:41.949757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5458db-5729-462c-98ff-1de6e958bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:41.950078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5458db-5729-462c-98ff-1de6e958bae0 None admin] PATH_INFO: `/v3/users/4ff582f3a88d4aa9b007b0072e26e770` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:41.951345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5458db-5729-462c-98ff-1de6e958bae0 None admin] RBAC: Authorizing `identity:get_user(user_id=4ff582f3a88d4aa9b007b0072e26e770)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:41.952940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5458db-5729-462c-98ff-1de6e958bae0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:41.954686 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 116/231] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:41 2022] GET /identity/v3/users/4ff582f3a88d4aa9b007b0072e26e770 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:41.959941 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5458db-5729-462c-98ff-1de6e958bae0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:41.979282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:41.992809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 116/232] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:36:41 2022] PUT /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/users/4ff582f3a88d4aa9b007b0072e26e770/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:36:42.084929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5458db-5729-462c-98ff-1de6e958bae0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:42.141906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa324-bd61-4eb4-8315-956ed99903cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:42.142535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa324-bd61-4eb4-8315-956ed99903cb None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:42.142866 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa324-bd61-4eb4-8315-956ed99903cb None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:42.143147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa324-bd61-4eb4-8315-956ed99903cb None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:42.145827 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefa324-bd61-4eb4-8315-956ed99903cb None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:42.147326 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefa324-bd61-4eb4-8315-956ed99903cb None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:42.149295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 117/233] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:41 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:42.155526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f97e55-8570-49c5-a40c-34af8b136364 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:42.283320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f97e55-8570-49c5-a40c-34af8b136364 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:42.332945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c05dd-42f8-4152-ac4e-518afcbad1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:42.333636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c05dd-42f8-4152-ac4e-518afcbad1a3 None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:42.333918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c05dd-42f8-4152-ac4e-518afcbad1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:42.334195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c05dd-42f8-4152-ac4e-518afcbad1a3 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/users/4ff582f3a88d4aa9b007b0072e26e770/roles/e5562064df7e4f1a96a35d581b4f28c4` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:42.342412 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c05dd-42f8-4152-ac4e-518afcbad1a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d0eaf03e66c44178fdd9445fd20713b, user_id=4ff582f3a88d4aa9b007b0072e26e770, role_id=e5562064df7e4f1a96a35d581b4f28c4)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:42.343871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c05dd-42f8-4152-ac4e-518afcbad1a3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:42.438486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 117/234] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:36:42 2022] PUT /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/users/4ff582f3a88d4aa9b007b0072e26e770/roles/e5562064df7e4f1a96a35d581b4f28c4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:36:42.676070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f891-ce35-411d-a558-5538ca535fa7 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:42.676446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f891-ce35-411d-a558-5538ca535fa7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:42.676644 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f891-ce35-411d-a558-5538ca535fa7 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:42.678165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 118/235] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:42.685417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38db00-df32-4131-bea8-d31b51f3e9fa None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:42.686093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38db00-df32-4131-bea8-d31b51f3e9fa None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:42.686559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38db00-df32-4131-bea8-d31b51f3e9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:42.706280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-1a38db00-df32-4131-bea8-d31b51f3e9fa None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:42.707794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1a38db00-df32-4131-bea8-d31b51f3e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:42.736725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:42.749961 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4bdf1-8b8a-4a9a-a002-21abc61d7097 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:42.750307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4bdf1-8b8a-4a9a-a002-21abc61d7097 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:42.750514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4bdf1-8b8a-4a9a-a002-21abc61d7097 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:42.751863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 119/236] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:42.760867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c2c7c-a133-418e-b211-cbd8eaa76c44 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:42.761751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c2c7c-a133-418e-b211-cbd8eaa76c44 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:42.762055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c2c7c-a133-418e-b211-cbd8eaa76c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:42.781944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-5a6c2c7c-a133-418e-b211-cbd8eaa76c44 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:42.802362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5a6c2c7c-a133-418e-b211-cbd8eaa76c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:42.802515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 118/237] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:42.858406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 120/238] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:43.124288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad1347-15af-41e0-a3e4-1fb05315e86c None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:43.124979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad1347-15af-41e0-a3e4-1fb05315e86c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:43.125453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad1347-15af-41e0-a3e4-1fb05315e86c None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:43.127019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 119/239] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:43.132162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654ebc-7610-4ccd-8a3c-696495ba58e5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:43.132624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654ebc-7610-4ccd-8a3c-696495ba58e5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:43.132795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff654ebc-7610-4ccd-8a3c-696495ba58e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:43.138557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad1347-15af-41e0-a3e4-1fb05315e86c None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:43.161636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-ff654ebc-7610-4ccd-8a3c-696495ba58e5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:43.162840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ff654ebc-7610-4ccd-8a3c-696495ba58e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:43.179162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:43.257451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 121/240] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:43.264675 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff654ebc-7610-4ccd-8a3c-696495ba58e5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:43.297107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad1347-15af-41e0-a3e4-1fb05315e86c None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:43.369051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07501d2d-5ee8-4324-820e-36de4f3b8839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:43.369755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501d2d-5ee8-4324-820e-36de4f3b8839 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:43.370033 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501d2d-5ee8-4324-820e-36de4f3b8839 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:43.370805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501d2d-5ee8-4324-820e-36de4f3b8839 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:43.397586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07501d2d-5ee8-4324-820e-36de4f3b8839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-07501d2d-5ee8-4324-820e-36de4f3b8839 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:43.406242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:43.407274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:43.408088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 120/241] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:43.414402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07501d2d-5ee8-4324-820e-36de4f3b8839 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:43.462498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff654ebc-7610-4ccd-8a3c-696495ba58e5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:43.480908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:43.501088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a6889-2a67-4e57-81f5-608c063dcfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:43.501744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6889-2a67-4e57-81f5-608c063dcfb0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:43.502021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6889-2a67-4e57-81f5-608c063dcfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:43.502291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6889-2a67-4e57-81f5-608c063dcfb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:43.503424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a6889-2a67-4e57-81f5-608c063dcfb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:43.505127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a6889-2a67-4e57-81f5-608c063dcfb0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:43.507249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 122/242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:43.517603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a6889-2a67-4e57-81f5-608c063dcfb0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:43.540821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:43.611388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07501d2d-5ee8-4324-820e-36de4f3b8839 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:43.647502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a6889-2a67-4e57-81f5-608c063dcfb0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:43.651268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e0f44-b12f-483c-8849-23169221d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:43.651925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e0f44-b12f-483c-8849-23169221d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:43.652279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e0f44-b12f-483c-8849-23169221d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:43.652611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e0f44-b12f-483c-8849-23169221d7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:43.653343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e0f44-b12f-483c-8849-23169221d7b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:43.653671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e0f44-b12f-483c-8849-23169221d7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:43.655316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e0f44-b12f-483c-8849-23169221d7b9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:43.672631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 121/243] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:43.674062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e0f44-b12f-483c-8849-23169221d7b9 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:43.691134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14485795-7358-4c66-b9e9-728febb22ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:43.691759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14485795-7358-4c66-b9e9-728febb22ecb None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:43.692048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14485795-7358-4c66-b9e9-728febb22ecb None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:43.692316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14485795-7358-4c66-b9e9-728febb22ecb None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:43.695076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14485795-7358-4c66-b9e9-728febb22ecb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:43.695076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14485795-7358-4c66-b9e9-728febb22ecb None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:43.776289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:43.793591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e0f44-b12f-483c-8849-23169221d7b9 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:43.832673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e3a4-c5ab-4d0d-98f0-3dcdc51acf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:43.833391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e3a4-c5ab-4d0d-98f0-3dcdc51acf9f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:43.833673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e3a4-c5ab-4d0d-98f0-3dcdc51acf9f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:43.833990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e3a4-c5ab-4d0d-98f0-3dcdc51acf9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:43.847614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85e3a4-c5ab-4d0d-98f0-3dcdc51acf9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-6b85e3a4-c5ab-4d0d-98f0-3dcdc51acf9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:43.853984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:43.861972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 122/244] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:43.862857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e3a4-c5ab-4d0d-98f0-3dcdc51acf9f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:43.936505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 123/245] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:36:43 2022] POST /identity/v3/users => generated 293 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:43.937850 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14485795-7358-4c66-b9e9-728febb22ecb None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:44.028099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e3a4-c5ab-4d0d-98f0-3dcdc51acf9f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:44.093987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:44.114521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136621c-0f44-4d9e-bf72-aef52faff4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:44.115171 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136621c-0f44-4d9e-bf72-aef52faff4a1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:44.115446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136621c-0f44-4d9e-bf72-aef52faff4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:44.115713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136621c-0f44-4d9e-bf72-aef52faff4a1 None admin] PATH_INFO: `/v3/users/f30464b32b7f49ff9422de68c57f65b1` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:44.135764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136621c-0f44-4d9e-bf72-aef52faff4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=f30464b32b7f49ff9422de68c57f65b1)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:44.138221 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136621c-0f44-4d9e-bf72-aef52faff4a1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:44.140290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 123/246] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:43 2022] GET /identity/v3/users/f30464b32b7f49ff9422de68c57f65b1 => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:44.146915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136621c-0f44-4d9e-bf72-aef52faff4a1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:44.147964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14485795-7358-4c66-b9e9-728febb22ecb None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:44.153434 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:44.191668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980ad83-92c4-410e-ab1e-4523a73ccd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:44.192358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ad83-92c4-410e-ab1e-4523a73ccd75 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:44.192673 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ad83-92c4-410e-ab1e-4523a73ccd75 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:44.192945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ad83-92c4-410e-ab1e-4523a73ccd75 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:44.193620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980ad83-92c4-410e-ab1e-4523a73ccd75 None admin] RBAC: Adding query filter params (name=member) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:44.193922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980ad83-92c4-410e-ab1e-4523a73ccd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:44.195497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980ad83-92c4-410e-ab1e-4523a73ccd75 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:44.214646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 124/247] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:44.221071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980ad83-92c4-410e-ab1e-4523a73ccd75 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:44.287931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136621c-0f44-4d9e-bf72-aef52faff4a1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:44.340695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a13b3-01f4-4813-9b12-6e9fe9acb2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:44.342038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a13b3-01f4-4813-9b12-6e9fe9acb2f4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:44.342322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a13b3-01f4-4813-9b12-6e9fe9acb2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:44.342598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a13b3-01f4-4813-9b12-6e9fe9acb2f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:44.364592 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980ad83-92c4-410e-ab1e-4523a73ccd75 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:44.405053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:44.413112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267a81d-5928-437c-8d32-6e5ed6f5a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:44.414015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267a81d-5928-437c-8d32-6e5ed6f5a481 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:44.422421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267a81d-5928-437c-8d32-6e5ed6f5a481 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:44.422421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267a81d-5928-437c-8d32-6e5ed6f5a481 None admin] PATH_INFO: `/v3/users/2bb8ce95c4bb46d18a38e0572743885f` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:44.422421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267a81d-5928-437c-8d32-6e5ed6f5a481 None admin] RBAC: Authorizing `identity:get_user(user_id=2bb8ce95c4bb46d18a38e0572743885f)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:44.422421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267a81d-5928-437c-8d32-6e5ed6f5a481 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:44.422421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 125/248] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:44 2022] GET /identity/v3/users/2bb8ce95c4bb46d18a38e0572743885f => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:44.422757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cacdf-05d3-43dc-87f7-701f68582853 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:44.423068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cacdf-05d3-43dc-87f7-701f68582853 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:44.423327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cacdf-05d3-43dc-87f7-701f68582853 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:44.425101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 126/249] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:44.428669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cacdf-05d3-43dc-87f7-701f68582853 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:44.444714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a13b3-01f4-4813-9b12-6e9fe9acb2f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:44.447759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a13b3-01f4-4813-9b12-6e9fe9acb2f4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:44.449681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:44.564165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cacdf-05d3-43dc-87f7-701f68582853 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:44.603067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 124/250] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:44.604169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bce390-5b49-4fe4-b725-c808eb64a7c5 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:44.604446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bce390-5b49-4fe4-b725-c808eb64a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:44.606818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bce390-5b49-4fe4-b725-c808eb64a7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:44.634977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff071cd-38d5-4f15-8704-7ea684ceda4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:44.635682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff071cd-38d5-4f15-8704-7ea684ceda4c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:44.635998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff071cd-38d5-4f15-8704-7ea684ceda4c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:44.636266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff071cd-38d5-4f15-8704-7ea684ceda4c None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:44.639162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff071cd-38d5-4f15-8704-7ea684ceda4c None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:44.642149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff071cd-38d5-4f15-8704-7ea684ceda4c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:44.643067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e6bce390-5b49-4fe4-b725-c808eb64a7c5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:44.644349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 127/251] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:44 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:44.649719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e6bce390-5b49-4fe4-b725-c808eb64a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:44.652677 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff071cd-38d5-4f15-8704-7ea684ceda4c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:44.746256 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 125/252] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:44.747188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bce390-5b49-4fe4-b725-c808eb64a7c5 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:44.817638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:44.821295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:44.862788 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff071cd-38d5-4f15-8704-7ea684ceda4c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:44.905683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ca3c1-ae2b-4cf4-89a7-a9502fda9f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:44.906495 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca3c1-ae2b-4cf4-89a7-a9502fda9f5e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:44.906780 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca3c1-ae2b-4cf4-89a7-a9502fda9f5e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:44.907469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ca3c1-ae2b-4cf4-89a7-a9502fda9f5e None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:44.908827 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ca3c1-ae2b-4cf4-89a7-a9502fda9f5e None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:44.910304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ca3c1-ae2b-4cf4-89a7-a9502fda9f5e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:44.912149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 128/253] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:44 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:44.913316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586640-2b39-479f-bdfa-31aeb7a37b3b None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:44.914006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586640-2b39-479f-bdfa-31aeb7a37b3b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:44.914286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586640-2b39-479f-bdfa-31aeb7a37b3b None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:44.915841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 129/254] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:44.918834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586640-2b39-479f-bdfa-31aeb7a37b3b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:44.962782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bce390-5b49-4fe4-b725-c808eb64a7c5 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:45.042051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2174-c24a-4322-b0f7-c02f8c12c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:45.043349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2174-c24a-4322-b0f7-c02f8c12c029 None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:45.043633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2174-c24a-4322-b0f7-c02f8c12c029 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:45.043907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e2174-c24a-4322-b0f7-c02f8c12c029 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/users/2bb8ce95c4bb46d18a38e0572743885f/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:45.045893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2174-c24a-4322-b0f7-c02f8c12c029 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d0eaf03e66c44178fdd9445fd20713b, user_id=2bb8ce95c4bb46d18a38e0572743885f, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:45.047397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e2174-c24a-4322-b0f7-c02f8c12c029 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:45.059280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586640-2b39-479f-bdfa-31aeb7a37b3b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:45.102846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a6995-95f0-486e-abf1-f3fa51cd9424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:45.103409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a6995-95f0-486e-abf1-f3fa51cd9424 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:45.103688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a6995-95f0-486e-abf1-f3fa51cd9424 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:45.103957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a6995-95f0-486e-abf1-f3fa51cd9424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:45.105557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a6995-95f0-486e-abf1-f3fa51cd9424 None admin] RBAC: Adding query filter params (role.id=0be962a218de4ebd87c3062a16459c98, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b, user.id=f30464b32b7f49ff9422de68c57f65b1) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:45.105869 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a6995-95f0-486e-abf1-f3fa51cd9424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:45.107379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a6995-95f0-486e-abf1-f3fa51cd9424 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:45.109714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:45.114546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 130/255] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:44 2022] GET /identity/v3/role_assignments?user.id=f30464b32b7f49ff9422de68c57f65b1&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=0be962a218de4ebd87c3062a16459c98 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:45.115579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a496b-a7ba-49e1-868c-db1f3c3a6988 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:45.115860 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a496b-a7ba-49e1-868c-db1f3c3a6988 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:45.116130 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a496b-a7ba-49e1-868c-db1f3c3a6988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:45.137199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-5c7a496b-a7ba-49e1-868c-db1f3c3a6988 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:45.138894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5c7a496b-a7ba-49e1-868c-db1f3c3a6988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:45.158903 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 126/256] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:36:44 2022] PUT /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/users/2bb8ce95c4bb46d18a38e0572743885f/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:36:45.159870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2174-c24a-4322-b0f7-c02f8c12c029 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:45.234383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 131/257] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:45.335030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:45.345450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e2174-c24a-4322-b0f7-c02f8c12c029 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:45.390426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67cee5-5be0-4a64-b7ac-c58522e70fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:45.391010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67cee5-5be0-4a64-b7ac-c58522e70fd5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:45.391290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67cee5-5be0-4a64-b7ac-c58522e70fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:45.391561 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67cee5-5be0-4a64-b7ac-c58522e70fd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:45.409620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67cee5-5be0-4a64-b7ac-c58522e70fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-8c67cee5-5be0-4a64-b7ac-c58522e70fd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:45.414437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:45.415308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:45.416114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 127/258] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:36:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:45.423518 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a496b-a7ba-49e1-868c-db1f3c3a6988 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:45.578894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a496b-a7ba-49e1-868c-db1f3c3a6988 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:45.597325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67cee5-5be0-4a64-b7ac-c58522e70fd5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:45.616913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:45.620673 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1698219-a60f-497d-9f7e-e103bbf61868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:45.621304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1698219-a60f-497d-9f7e-e103bbf61868 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:45.621585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1698219-a60f-497d-9f7e-e103bbf61868 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:45.621858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1698219-a60f-497d-9f7e-e103bbf61868 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:45.622641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1698219-a60f-497d-9f7e-e103bbf61868 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:45.622960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1698219-a60f-497d-9f7e-e103bbf61868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:45.624478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1698219-a60f-497d-9f7e-e103bbf61868 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:45.634361 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 132/259] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:45.639671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1698219-a60f-497d-9f7e-e103bbf61868 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:45.764818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67cee5-5be0-4a64-b7ac-c58522e70fd5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:45.821861 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c25415-098a-4fe1-a56d-656115d4dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:45.822875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25415-098a-4fe1-a56d-656115d4dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:45.823878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25415-098a-4fe1-a56d-656115d4dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:45.824992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25415-098a-4fe1-a56d-656115d4dbe1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:45.836590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c25415-098a-4fe1-a56d-656115d4dbe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-22c25415-098a-4fe1-a56d-656115d4dbe1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:45.842600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:45.843523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:45.844309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:45.847519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 128/260] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:36:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:45.853854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c25415-098a-4fe1-a56d-656115d4dbe1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:45.878417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1698219-a60f-497d-9f7e-e103bbf61868 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:45.901005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:45.964858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773c5bb-3228-400e-94bd-09673ddf0fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:45.965511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773c5bb-3228-400e-94bd-09673ddf0fe0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:45.965787 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773c5bb-3228-400e-94bd-09673ddf0fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:45.966057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773c5bb-3228-400e-94bd-09673ddf0fe0 None admin] PATH_INFO: `/v3/users/4ff582f3a88d4aa9b007b0072e26e770` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:45.972536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773c5bb-3228-400e-94bd-09673ddf0fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=4ff582f3a88d4aa9b007b0072e26e770)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:45.972536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773c5bb-3228-400e-94bd-09673ddf0fe0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:45.976859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 133/261] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:45 2022] GET /identity/v3/users/4ff582f3a88d4aa9b007b0072e26e770 => generated 283 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:45.977726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773c5bb-3228-400e-94bd-09673ddf0fe0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:46.066688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c25415-098a-4fe1-a56d-656115d4dbe1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:46.105428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf3609-b78a-4375-b929-7b5063c3e837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:46.106045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf3609-b78a-4375-b929-7b5063c3e837 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:46.106473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf3609-b78a-4375-b929-7b5063c3e837 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:46.106747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf3609-b78a-4375-b929-7b5063c3e837 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:46.107419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf3609-b78a-4375-b929-7b5063c3e837 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:46.107721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf3609-b78a-4375-b929-7b5063c3e837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:46.109279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf3609-b78a-4375-b929-7b5063c3e837 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:46.118722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 129/262] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:36:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:46.124750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf3609-b78a-4375-b929-7b5063c3e837 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:46.134624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:46.208968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:46.230660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773c5bb-3228-400e-94bd-09673ddf0fe0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:46.235496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf3609-b78a-4375-b929-7b5063c3e837 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:46.271738 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cba24-b79f-40b7-b252-1f076ecd8530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:46.272385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cba24-b79f-40b7-b252-1f076ecd8530 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:46.272695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cba24-b79f-40b7-b252-1f076ecd8530 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:46.272974 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cba24-b79f-40b7-b252-1f076ecd8530 None admin] PATH_INFO: `/v3/users/4ff582f3a88d4aa9b007b0072e26e770` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:46.274239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cba24-b79f-40b7-b252-1f076ecd8530 None admin] RBAC: Authorizing `identity:get_user(user_id=4ff582f3a88d4aa9b007b0072e26e770)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:46.276034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cba24-b79f-40b7-b252-1f076ecd8530 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:46.278729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 130/263] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:46 2022] GET /identity/v3/users/4ff582f3a88d4aa9b007b0072e26e770 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:46.284450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cba24-b79f-40b7-b252-1f076ecd8530 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:46.293365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df67e69-9415-4b30-88b6-c7dc87be8cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:46.294057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df67e69-9415-4b30-88b6-c7dc87be8cbb None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:46.294298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df67e69-9415-4b30-88b6-c7dc87be8cbb None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:46.294571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df67e69-9415-4b30-88b6-c7dc87be8cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:46.400544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cba24-b79f-40b7-b252-1f076ecd8530 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:46.442077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0c3e0-a9a5-428a-81ff-64c8eb8de44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:46.442713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c3e0-a9a5-428a-81ff-64c8eb8de44b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:46.442995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c3e0-a9a5-428a-81ff-64c8eb8de44b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:46.443272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c3e0-a9a5-428a-81ff-64c8eb8de44b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:46.459917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df67e69-9415-4b30-88b6-c7dc87be8cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:46.462391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df67e69-9415-4b30-88b6-c7dc87be8cbb None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:46.469013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:46.541452 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0c3e0-a9a5-428a-81ff-64c8eb8de44b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:46.542978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0c3e0-a9a5-428a-81ff-64c8eb8de44b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:46.596922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:46.706954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 134/264] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:46.714428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df67e69-9415-4b30-88b6-c7dc87be8cbb None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:46.750467 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 131/265] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 15:36:46.756257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0c3e0-a9a5-428a-81ff-64c8eb8de44b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:46.821127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:46.903006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0c3e0-a9a5-428a-81ff-64c8eb8de44b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:46.942797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6051ef-7ec5-436e-acba-744fa6b20aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:46.943437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6051ef-7ec5-436e-acba-744fa6b20aab None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:46.943711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6051ef-7ec5-436e-acba-744fa6b20aab None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:46.943979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6051ef-7ec5-436e-acba-744fa6b20aab None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:46.945129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6051ef-7ec5-436e-acba-744fa6b20aab None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:46.948941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6051ef-7ec5-436e-acba-744fa6b20aab None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:46.949154 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 132/266] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:46 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:46.955249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6051ef-7ec5-436e-acba-744fa6b20aab None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:46.975021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df67e69-9415-4b30-88b6-c7dc87be8cbb None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:47.043286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775437b-805b-4549-b609-4ef314bcfdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:47.044485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775437b-805b-4549-b609-4ef314bcfdc8 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:47.045060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775437b-805b-4549-b609-4ef314bcfdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:47.045695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775437b-805b-4549-b609-4ef314bcfdc8 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:47.050523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775437b-805b-4549-b609-4ef314bcfdc8 None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:47.052357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775437b-805b-4549-b609-4ef314bcfdc8 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:47.054525 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 135/267] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:46 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:47.061969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775437b-805b-4549-b609-4ef314bcfdc8 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:47.063398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6051ef-7ec5-436e-acba-744fa6b20aab None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:47.076465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:47.103920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86c2f6-3a71-4f25-b514-1ffd0f596168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:47.105633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c2f6-3a71-4f25-b514-1ffd0f596168 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:47.106676 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c2f6-3a71-4f25-b514-1ffd0f596168 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:47.107174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86c2f6-3a71-4f25-b514-1ffd0f596168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:47.108299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86c2f6-3a71-4f25-b514-1ffd0f596168 None admin] RBAC: Adding query filter params (role.id=e5562064df7e4f1a96a35d581b4f28c4, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b, user.id=4ff582f3a88d4aa9b007b0072e26e770) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:47.109575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86c2f6-3a71-4f25-b514-1ffd0f596168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:47.114575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86c2f6-3a71-4f25-b514-1ffd0f596168 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:47.126198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 133/268] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:46 2022] GET /identity/v3/role_assignments?user.id=4ff582f3a88d4aa9b007b0072e26e770&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=e5562064df7e4f1a96a35d581b4f28c4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:47.132937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446e7c-be1c-4e11-9e7d-5ec721ba46a1 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:47.134824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:47.136480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446e7c-be1c-4e11-9e7d-5ec721ba46a1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:47.137885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446e7c-be1c-4e11-9e7d-5ec721ba46a1 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:47.141984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 134/269] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:47.147777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e179d05-0c45-4b6e-8d4b-cd57bce22e59 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:47.148582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e179d05-0c45-4b6e-8d4b-cd57bce22e59 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:47.151337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e179d05-0c45-4b6e-8d4b-cd57bce22e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:47.197908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3e179d05-0c45-4b6e-8d4b-cd57bce22e59 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:47.201005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3e179d05-0c45-4b6e-8d4b-cd57bce22e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:47.322779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775437b-805b-4549-b609-4ef314bcfdc8 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:47.394374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 135/270] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:47.410292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d912f-7ed8-4139-a1b1-7659d5b58ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:47.411291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d912f-7ed8-4139-a1b1-7659d5b58ed4 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:47.411764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d912f-7ed8-4139-a1b1-7659d5b58ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:47.412280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d912f-7ed8-4139-a1b1-7659d5b58ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:47.413261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d912f-7ed8-4139-a1b1-7659d5b58ed4 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b, user.id=4ff582f3a88d4aa9b007b0072e26e770) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:47.413827 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d912f-7ed8-4139-a1b1-7659d5b58ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:47.415484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d912f-7ed8-4139-a1b1-7659d5b58ed4 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:47.431157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 136/271] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:47 2022] GET /identity/v3/role_assignments?user.id=4ff582f3a88d4aa9b007b0072e26e770&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=eeb6551eeb934053866fc821b511b5dd => generated 608 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:47.538876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c634e-5d71-49bc-82d4-3362b6d65857 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:47.539389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c634e-5d71-49bc-82d4-3362b6d65857 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:47.539462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c634e-5d71-49bc-82d4-3362b6d65857 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:47.541083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 136/272] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:47.547662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db81443-3f8a-4bbd-9fc1-6bb3c68601c1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:47.548292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db81443-3f8a-4bbd-9fc1-6bb3c68601c1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:47.549067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db81443-3f8a-4bbd-9fc1-6bb3c68601c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:47.574642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-6db81443-3f8a-4bbd-9fc1-6bb3c68601c1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:47.576222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6db81443-3f8a-4bbd-9fc1-6bb3c68601c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:47.679477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 137/273] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:47.840310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c634e-5d71-49bc-82d4-3362b6d65857 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:47.983127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c634e-5d71-49bc-82d4-3362b6d65857 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:47.986189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:48.028262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed60ef4-5912-4c99-aa17-74dcf8972917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:48.029040 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60ef4-5912-4c99-aa17-74dcf8972917 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:48.029321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60ef4-5912-4c99-aa17-74dcf8972917 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:48.029594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60ef4-5912-4c99-aa17-74dcf8972917 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:48.032481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed60ef4-5912-4c99-aa17-74dcf8972917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:48.034125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed60ef4-5912-4c99-aa17-74dcf8972917 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:48.036177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 137/274] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:48.042068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db81443-3f8a-4bbd-9fc1-6bb3c68601c1 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:48.052054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed60ef4-5912-4c99-aa17-74dcf8972917 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:48.084319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:48.200587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed60ef4-5912-4c99-aa17-74dcf8972917 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:48.207486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db81443-3f8a-4bbd-9fc1-6bb3c68601c1 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:48.241721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a0f5e-62ed-456b-a5df-950b2c9b7799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:48.242461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a0f5e-62ed-456b-a5df-950b2c9b7799 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:48.242731 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a0f5e-62ed-456b-a5df-950b2c9b7799 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:48.242997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a0f5e-62ed-456b-a5df-950b2c9b7799 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:48.247118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a619a09-067a-483f-bdef-b0d598f4e25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:48.247731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a619a09-067a-483f-bdef-b0d598f4e25b None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:48.248006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a619a09-067a-483f-bdef-b0d598f4e25b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:48.248279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a619a09-067a-483f-bdef-b0d598f4e25b None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:48.248942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a619a09-067a-483f-bdef-b0d598f4e25b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:48.250917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a619a09-067a-483f-bdef-b0d598f4e25b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:48.254754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a0f5e-62ed-456b-a5df-950b2c9b7799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-fb3a0f5e-62ed-456b-a5df-950b2c9b7799 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:48.259797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:48.261623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 138/275] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:48.262671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609d0d-be5a-4327-8473-532c58f43a19 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:48.263585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609d0d-be5a-4327-8473-532c58f43a19 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:48.263585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609d0d-be5a-4327-8473-532c58f43a19 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:48.269038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 139/276] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:48.270341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0609d0d-be5a-4327-8473-532c58f43a19 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:48.304867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:48.368629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 138/277] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:36:48 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:48.371614 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7580bd-dd01-4c74-8070-c13fe6a746e0 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:48.372195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7580bd-dd01-4c74-8070-c13fe6a746e0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:48.373164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7580bd-dd01-4c74-8070-c13fe6a746e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:48.401635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4d7580bd-dd01-4c74-8070-c13fe6a746e0 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:48.403767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4d7580bd-dd01-4c74-8070-c13fe6a746e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:48.415960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0609d0d-be5a-4327-8473-532c58f43a19 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:48.478351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5e46-8ffa-47e2-a555-68ba17012fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:48.479330 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5e46-8ffa-47e2-a555-68ba17012fd9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:48.479807 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5e46-8ffa-47e2-a555-68ba17012fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:48.480234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5e46-8ffa-47e2-a555-68ba17012fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:48.481424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d5e46-8ffa-47e2-a555-68ba17012fd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:48.481876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d5e46-8ffa-47e2-a555-68ba17012fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:48.484456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d5e46-8ffa-47e2-a555-68ba17012fd9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:48.496268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 139/278] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:48.497182 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 140/279] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:48.498314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137014-a243-4875-bb43-d6cabf0d36df None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:48.498870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137014-a243-4875-bb43-d6cabf0d36df None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:48.499326 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c137014-a243-4875-bb43-d6cabf0d36df None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:48.501089 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 140/280] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:48.510195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b6f3b-c5b7-42a9-b757-e1c31586a181 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:48.510396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5e46-8ffa-47e2-a555-68ba17012fd9 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:48.511595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b6f3b-c5b7-42a9-b757-e1c31586a181 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:48.512096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b6f3b-c5b7-42a9-b757-e1c31586a181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:48.529893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:48.537601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d72b6f3b-c5b7-42a9-b757-e1c31586a181 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:48.539117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d72b6f3b-c5b7-42a9-b757-e1c31586a181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:48.633023 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 141/281] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:48.654337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:48.662026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5e46-8ffa-47e2-a555-68ba17012fd9 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:48.706833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb267b-93a2-42e8-bd41-1b262fa19d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:48.708104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb267b-93a2-42e8-bd41-1b262fa19d82 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:48.708642 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb267b-93a2-42e8-bd41-1b262fa19d82 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:48.709115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb267b-93a2-42e8-bd41-1b262fa19d82 None admin] PATH_INFO: `/v3/users/ff392bde79824d7fab4bf3b9ed3956bb` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:48.726769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb267b-93a2-42e8-bd41-1b262fa19d82 None admin] RBAC: Authorizing `identity:get_user(user_id=ff392bde79824d7fab4bf3b9ed3956bb)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:48.728246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb267b-93a2-42e8-bd41-1b262fa19d82 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:48.731234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 141/282] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:48 2022] GET /identity/v3/users/ff392bde79824d7fab4bf3b9ed3956bb => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:48.737097 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b6f3b-c5b7-42a9-b757-e1c31586a181 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:48.793086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb267b-93a2-42e8-bd41-1b262fa19d82 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:48.865616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b6f3b-c5b7-42a9-b757-e1c31586a181 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:48.932102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91c871-6d47-4991-84d6-1563dee931f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:48.933292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91c871-6d47-4991-84d6-1563dee931f9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:48.933576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91c871-6d47-4991-84d6-1563dee931f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:48.933843 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91c871-6d47-4991-84d6-1563dee931f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:48.934574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91c871-6d47-4991-84d6-1563dee931f9 None admin] RBAC: Adding query filter params (role.id=23c81c3dc8f743289ecb566849eb8324, user.id=ff392bde79824d7fab4bf3b9ed3956bb, scope.system=all) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:48.934880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91c871-6d47-4991-84d6-1563dee931f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:48.936348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91c871-6d47-4991-84d6-1563dee931f9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:48.949687 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 142/283] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Aug 22 15:36:48 2022] GET /identity/v3/role_assignments?user.id=ff392bde79824d7fab4bf3b9ed3956bb&scope.system=all&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:48.949983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:48.951418 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91c871-6d47-4991-84d6-1563dee931f9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:48.974882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb267b-93a2-42e8-bd41-1b262fa19d82 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:49.034956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc858-8686-43d1-8d9a-07446e602653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:49.035699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc858-8686-43d1-8d9a-07446e602653 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:49.036075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc858-8686-43d1-8d9a-07446e602653 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:49.036429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc858-8686-43d1-8d9a-07446e602653 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:49.065503 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdc858-8686-43d1-8d9a-07446e602653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-abbdc858-8686-43d1-8d9a-07446e602653 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:49.070665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:49.071583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:49.072389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 142/284] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:36:49.078614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc858-8686-43d1-8d9a-07446e602653 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:49.116081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:49.134285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91c871-6d47-4991-84d6-1563dee931f9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:49.199599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d41b6-2477-4ff1-a789-e7473545c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:49.200340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d41b6-2477-4ff1-a789-e7473545c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:49.200679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d41b6-2477-4ff1-a789-e7473545c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:49.200991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d41b6-2477-4ff1-a789-e7473545c3d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:49.212982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d41b6-2477-4ff1-a789-e7473545c3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-fb8d41b6-2477-4ff1-a789-e7473545c3d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:49.218834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:49.219712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:49.220537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 143/285] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:49.233576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d41b6-2477-4ff1-a789-e7473545c3d2 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:49.312088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:49.343983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc858-8686-43d1-8d9a-07446e602653 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:49.382655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d41b6-2477-4ff1-a789-e7473545c3d2 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:49.384830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39c87-f802-4355-acab-c5251e4a068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:49.385445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39c87-f802-4355-acab-c5251e4a068f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:49.385783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39c87-f802-4355-acab-c5251e4a068f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:49.386559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39c87-f802-4355-acab-c5251e4a068f None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:49.387240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39c87-f802-4355-acab-c5251e4a068f None admin] RBAC: Adding query filter params (name=reader) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:49.387544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39c87-f802-4355-acab-c5251e4a068f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:49.389278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39c87-f802-4355-acab-c5251e4a068f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:49.408480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 143/286] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:49.414754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39c87-f802-4355-acab-c5251e4a068f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:49.477916 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64873-52f7-426e-ba4e-161ea853abac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:49.481592 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64873-52f7-426e-ba4e-161ea853abac None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:49.482292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64873-52f7-426e-ba4e-161ea853abac None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:49.482960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64873-52f7-426e-ba4e-161ea853abac None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:49.483938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf64873-52f7-426e-ba4e-161ea853abac None admin] RBAC: Adding query filter params (name=member) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:49.485389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf64873-52f7-426e-ba4e-161ea853abac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:49.487420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf64873-52f7-426e-ba4e-161ea853abac None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:49.513387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 144/287] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:49.519644 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64873-52f7-426e-ba4e-161ea853abac None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:49.598036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:49.643504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39c87-f802-4355-acab-c5251e4a068f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:49.649655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64873-52f7-426e-ba4e-161ea853abac None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:49.702211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:49.715301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2ba3f-4b01-47a5-9073-c24694e59997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:49.716949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2ba3f-4b01-47a5-9073-c24694e59997 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:49.719134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2ba3f-4b01-47a5-9073-c24694e59997 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:49.719633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2ba3f-4b01-47a5-9073-c24694e59997 None admin] PATH_INFO: `/v3/users/f30464b32b7f49ff9422de68c57f65b1` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:49.721886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2ba3f-4b01-47a5-9073-c24694e59997 None admin] RBAC: Authorizing `identity:get_user(user_id=f30464b32b7f49ff9422de68c57f65b1)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:49.724859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2ba3f-4b01-47a5-9073-c24694e59997 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:49.728626 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 144/288] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:49 2022] GET /identity/v3/users/f30464b32b7f49ff9422de68c57f65b1 => generated 297 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:49.730062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7193ae4-a98e-4cbf-b8be-be89335d82cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:49.731080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193ae4-a98e-4cbf-b8be-be89335d82cd None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:49.731556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193ae4-a98e-4cbf-b8be-be89335d82cd None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:49.732022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193ae4-a98e-4cbf-b8be-be89335d82cd None admin] PATH_INFO: `/v3/users/2bb8ce95c4bb46d18a38e0572743885f` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:49.733510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7193ae4-a98e-4cbf-b8be-be89335d82cd None admin] RBAC: Authorizing `identity:get_user(user_id=2bb8ce95c4bb46d18a38e0572743885f)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:49.734595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2ba3f-4b01-47a5-9073-c24694e59997 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:49.739125 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7193ae4-a98e-4cbf-b8be-be89335d82cd None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:49.742847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 145/289] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:49 2022] GET /identity/v3/users/2bb8ce95c4bb46d18a38e0572743885f => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:49.749487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7193ae4-a98e-4cbf-b8be-be89335d82cd None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:49.892729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7193ae4-a98e-4cbf-b8be-be89335d82cd None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:49.935652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2ba3f-4b01-47a5-9073-c24694e59997 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:49.942659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd845db9-3a2c-495e-a88e-9d212454d561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:49.943311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd845db9-3a2c-495e-a88e-9d212454d561 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:49.943596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd845db9-3a2c-495e-a88e-9d212454d561 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:49.943870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd845db9-3a2c-495e-a88e-9d212454d561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:49.985536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c8129-bab8-457b-8d69-fdfde4f5bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:49.986458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8129-bab8-457b-8d69-fdfde4f5bd44 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:49.986900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8129-bab8-457b-8d69-fdfde4f5bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:49.987244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8129-bab8-457b-8d69-fdfde4f5bd44 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:49.988775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c8129-bab8-457b-8d69-fdfde4f5bd44 None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:49.990260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c8129-bab8-457b-8d69-fdfde4f5bd44 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:49.992017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 145/290] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:49 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:50.004715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c8129-bab8-457b-8d69-fdfde4f5bd44 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:50.026558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:50.108757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:50.132167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd845db9-3a2c-495e-a88e-9d212454d561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:50.133683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd845db9-3a2c-495e-a88e-9d212454d561 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:50.156670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c8129-bab8-457b-8d69-fdfde4f5bd44 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:50.205219 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fa026-bf50-4836-bbec-c126e245fcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:50.206286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa026-bf50-4836-bbec-c126e245fcfc None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:50.206570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa026-bf50-4836-bbec-c126e245fcfc None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:50.206829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa026-bf50-4836-bbec-c126e245fcfc None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/users/f30464b32b7f49ff9422de68c57f65b1/roles/0be962a218de4ebd87c3062a16459c98` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:50.208839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fa026-bf50-4836-bbec-c126e245fcfc None admin] RBAC: Authorizing `identity:create_grant(project_id=7d0eaf03e66c44178fdd9445fd20713b, user_id=f30464b32b7f49ff9422de68c57f65b1, role_id=0be962a218de4ebd87c3062a16459c98)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:50.210434 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fa026-bf50-4836-bbec-c126e245fcfc None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:50.283835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 146/291] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:36:50 2022] PUT /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/users/f30464b32b7f49ff9422de68c57f65b1/roles/0be962a218de4ebd87c3062a16459c98 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:36:50.316314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 146/292] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:50.322437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fa026-bf50-4836-bbec-c126e245fcfc None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:50.429110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:50.470515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fa026-bf50-4836-bbec-c126e245fcfc None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:50.521288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60cc0c-80bf-4b87-8292-4b602cc5e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:50.521949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60cc0c-80bf-4b87-8292-4b602cc5e546 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:50.522232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60cc0c-80bf-4b87-8292-4b602cc5e546 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:50.522507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60cc0c-80bf-4b87-8292-4b602cc5e546 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:50.523759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60cc0c-80bf-4b87-8292-4b602cc5e546 None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:50.525535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60cc0c-80bf-4b87-8292-4b602cc5e546 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:50.528192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 147/293] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:50 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:50.534800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd845db9-3a2c-495e-a88e-9d212454d561 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:50.645820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:50.661961 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd845db9-3a2c-495e-a88e-9d212454d561 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:50.716118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d952e-fb80-4f50-ba49-5290a72486e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:50.716756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d952e-fb80-4f50-ba49-5290a72486e9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:50.717136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d952e-fb80-4f50-ba49-5290a72486e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:50.723388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d952e-fb80-4f50-ba49-5290a72486e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:50.723388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d952e-fb80-4f50-ba49-5290a72486e9 None admin] RBAC: Adding query filter params (role.id=23c81c3dc8f743289ecb566849eb8324, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b, user.id=2bb8ce95c4bb46d18a38e0572743885f) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:50.723388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d952e-fb80-4f50-ba49-5290a72486e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:50.723388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d952e-fb80-4f50-ba49-5290a72486e9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:50.727040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 147/294] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:50 2022] GET /identity/v3/role_assignments?user.id=2bb8ce95c4bb46d18a38e0572743885f&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:50.994122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbab51-6f6f-4e48-9bc0-982f6d65cb20 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:50.994659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbab51-6f6f-4e48-9bc0-982f6d65cb20 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:50.994765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbab51-6f6f-4e48-9bc0-982f6d65cb20 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:50.997372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 148/295] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:51.003202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d59284-7693-49bb-92c5-f78ec17b0be4 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:51.003504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d59284-7693-49bb-92c5-f78ec17b0be4 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:51.003747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d59284-7693-49bb-92c5-f78ec17b0be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:51.028271 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b6d59284-7693-49bb-92c5-f78ec17b0be4 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:51.029587 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b6d59284-7693-49bb-92c5-f78ec17b0be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:51.073509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abbef-0498-4b02-a5d4-58c74806d3a4 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:51.073828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abbef-0498-4b02-a5d4-58c74806d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:51.074080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48abbef-0498-4b02-a5d4-58c74806d3a4 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:51.075527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 149/296] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:51.086312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5327c58-b915-4125-b948-5700960ff0d1 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:51.086616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5327c58-b915-4125-b948-5700960ff0d1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:51.086875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5327c58-b915-4125-b948-5700960ff0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:51.116373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c5327c58-b915-4125-b948-5700960ff0d1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:51.117973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c5327c58-b915-4125-b948-5700960ff0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:51.127344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 148/297] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:51.210123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 150/298] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:51.430549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf70db-3d4f-49a0-88d3-06c024f84cf2 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:51.430720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5327c58-b915-4125-b948-5700960ff0d1 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:51.430799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf70db-3d4f-49a0-88d3-06c024f84cf2 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:51.431131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf70db-3d4f-49a0-88d3-06c024f84cf2 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:51.433019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 149/299] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:51.440697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61219c1-96ef-4bc9-b2d5-99d550814ae7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:51.441081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61219c1-96ef-4bc9-b2d5-99d550814ae7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:51.441227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61219c1-96ef-4bc9-b2d5-99d550814ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:51.460640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-a61219c1-96ef-4bc9-b2d5-99d550814ae7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:51.461852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a61219c1-96ef-4bc9-b2d5-99d550814ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:51.530578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:51.554820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 150/300] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:51.555713 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61219c1-96ef-4bc9-b2d5-99d550814ae7 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:51.576116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5327c58-b915-4125-b948-5700960ff0d1 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:51.579043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:51.634817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f49067-21e0-46b9-9d4f-0b08b7b02ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:51.636637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f49067-21e0-46b9-9d4f-0b08b7b02ec2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:51.637424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f49067-21e0-46b9-9d4f-0b08b7b02ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:51.638117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f49067-21e0-46b9-9d4f-0b08b7b02ec2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:51.657178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f49067-21e0-46b9-9d4f-0b08b7b02ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-c4f49067-21e0-46b9-9d4f-0b08b7b02ec2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:51.664275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:51.665475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:51.666517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:51.669318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 151/301] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:51.676191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f49067-21e0-46b9-9d4f-0b08b7b02ec2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:51.700621 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61219c1-96ef-4bc9-b2d5-99d550814ae7 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:51.739262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db827c0-04d5-48da-9da0-a494243ce259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:51.740345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db827c0-04d5-48da-9da0-a494243ce259 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:51.740995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db827c0-04d5-48da-9da0-a494243ce259 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:51.741464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db827c0-04d5-48da-9da0-a494243ce259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:51.742956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db827c0-04d5-48da-9da0-a494243ce259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:51.744734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db827c0-04d5-48da-9da0-a494243ce259 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:51.747205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 151/302] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:51.753641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db827c0-04d5-48da-9da0-a494243ce259 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:51.796110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f49067-21e0-46b9-9d4f-0b08b7b02ec2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:51.832649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:51.845170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f552-8df3-490b-8868-6a4fbe041f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:51.846344 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f552-8df3-490b-8868-6a4fbe041f06 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:51.846975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f552-8df3-490b-8868-6a4fbe041f06 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:51.847435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f552-8df3-490b-8868-6a4fbe041f06 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:51.848865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1f552-8df3-490b-8868-6a4fbe041f06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:51.849624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1f552-8df3-490b-8868-6a4fbe041f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:51.852253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1f552-8df3-490b-8868-6a4fbe041f06 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:51.865309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 152/303] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:51.866665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f552-8df3-490b-8868-6a4fbe041f06 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:51.882309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db827c0-04d5-48da-9da0-a494243ce259 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:51.886684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:51.928627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c476ce-fed5-4916-b7fe-5c98075b6d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:51.929836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c476ce-fed5-4916-b7fe-5c98075b6d21 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:51.930267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c476ce-fed5-4916-b7fe-5c98075b6d21 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:51.930683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c476ce-fed5-4916-b7fe-5c98075b6d21 None admin] PATH_INFO: `/v3/groups` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:51.931465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c476ce-fed5-4916-b7fe-5c98075b6d21 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:51.935871 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c476ce-fed5-4916-b7fe-5c98075b6d21 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:51.984361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f552-8df3-490b-8868-6a4fbe041f06 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:52.021446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aac3d7-077f-4bbe-b09a-4cd9a72989bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:52.022252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 152/304] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Aug 22 15:36:51 2022] POST /identity/v3/groups => generated 229 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:36:52.022448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aac3d7-077f-4bbe-b09a-4cd9a72989bf None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:52.022698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aac3d7-077f-4bbe-b09a-4cd9a72989bf None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:52.022972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c476ce-fed5-4916-b7fe-5c98075b6d21 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:52.023080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aac3d7-077f-4bbe-b09a-4cd9a72989bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:52.041451 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aac3d7-077f-4bbe-b09a-4cd9a72989bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-e2aac3d7-077f-4bbe-b09a-4cd9a72989bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:52.049367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:52.050575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:52.051578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:52.059112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 153/305] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:52.060481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aac3d7-077f-4bbe-b09a-4cd9a72989bf None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:52.130831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:52.176392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c476ce-fed5-4916-b7fe-5c98075b6d21 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:52.191489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aac3d7-077f-4bbe-b09a-4cd9a72989bf None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:52.233721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8a8d5-80a5-4999-97d8-2f269de90816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:52.235120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a8d5-80a5-4999-97d8-2f269de90816 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:52.235120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a8d5-80a5-4999-97d8-2f269de90816 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:52.235120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a8d5-80a5-4999-97d8-2f269de90816 None admin] PATH_INFO: `/v3/users/a6f08d42b22d4d1fa234140a3c3f79f2` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:52.246368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aefcbf-69fa-47bc-b410-96e36cb65722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:52.247568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aefcbf-69fa-47bc-b410-96e36cb65722 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:52.247847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aefcbf-69fa-47bc-b410-96e36cb65722 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:52.248237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aefcbf-69fa-47bc-b410-96e36cb65722 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:52.249080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aefcbf-69fa-47bc-b410-96e36cb65722 None admin] RBAC: Adding query filter params (name=member) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:52.249504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aefcbf-69fa-47bc-b410-96e36cb65722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:52.251281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:52.251546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aefcbf-69fa-47bc-b410-96e36cb65722 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:52.256223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8a8d5-80a5-4999-97d8-2f269de90816 None admin] RBAC: Authorizing `identity:get_user(user_id=a6f08d42b22d4d1fa234140a3c3f79f2)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:52.257781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8a8d5-80a5-4999-97d8-2f269de90816 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:52.259753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 153/306] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:52 2022] GET /identity/v3/users/a6f08d42b22d4d1fa234140a3c3f79f2 => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:52.263153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 154/307] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:52.267734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8a8d5-80a5-4999-97d8-2f269de90816 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:52.268685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aefcbf-69fa-47bc-b410-96e36cb65722 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:52.418401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8a8d5-80a5-4999-97d8-2f269de90816 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:52.419567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aefcbf-69fa-47bc-b410-96e36cb65722 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:52.435946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:52.464116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc1d78-8c85-4c33-bf2f-f96eedcc5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:52.464805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1d78-8c85-4c33-bf2f-f96eedcc5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:52.465087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1d78-8c85-4c33-bf2f-f96eedcc5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:52.465361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1d78-8c85-4c33-bf2f-f96eedcc5ef4 None admin] PATH_INFO: `/v3/users/ff392bde79824d7fab4bf3b9ed3956bb` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:52.466544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc1d78-8c85-4c33-bf2f-f96eedcc5ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=ff392bde79824d7fab4bf3b9ed3956bb)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:52.467991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc1d78-8c85-4c33-bf2f-f96eedcc5ef4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:52.469634 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 155/308] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:52 2022] GET /identity/v3/users/ff392bde79824d7fab4bf3b9ed3956bb => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:52.474595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65da29-1b6f-4a84-b087-bf6f689292d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:52.475141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc1d78-8c85-4c33-bf2f-f96eedcc5ef4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:52.475884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65da29-1b6f-4a84-b087-bf6f689292d5 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:52.476375 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65da29-1b6f-4a84-b087-bf6f689292d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:52.476878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65da29-1b6f-4a84-b087-bf6f689292d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:52.478028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65da29-1b6f-4a84-b087-bf6f689292d5 None admin] RBAC: Adding query filter params (role.id=0be962a218de4ebd87c3062a16459c98, user.id=a6f08d42b22d4d1fa234140a3c3f79f2, scope.system=all) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:52.478541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65da29-1b6f-4a84-b087-bf6f689292d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:52.481786 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65da29-1b6f-4a84-b087-bf6f689292d5 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:52.492969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 154/309] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Aug 22 15:36:52 2022] GET /identity/v3/role_assignments?user.id=a6f08d42b22d4d1fa234140a3c3f79f2&scope.system=all&role.id=0be962a218de4ebd87c3062a16459c98 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:52.601071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc1d78-8c85-4c33-bf2f-f96eedcc5ef4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:52.642254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1600f-cde5-4d3c-b95a-37feb5754afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:52.642934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1600f-cde5-4d3c-b95a-37feb5754afb None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:52.643218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1600f-cde5-4d3c-b95a-37feb5754afb None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:52.643488 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1600f-cde5-4d3c-b95a-37feb5754afb None admin] PATH_INFO: `/v3/system/users/ff392bde79824d7fab4bf3b9ed3956bb/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:52.645025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1600f-cde5-4d3c-b95a-37feb5754afb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ff392bde79824d7fab4bf3b9ed3956bb, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:52.646416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1600f-cde5-4d3c-b95a-37feb5754afb None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:52.710192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad62b7-b6f4-4084-8c1c-99b63f2e601e None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:52.710726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad62b7-b6f4-4084-8c1c-99b63f2e601e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:52.710804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad62b7-b6f4-4084-8c1c-99b63f2e601e None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:52.712278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 155/310] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:52.717647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad4359-8ceb-4644-9c85-dba9a8b869e7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:52.717927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad4359-8ceb-4644-9c85-dba9a8b869e7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:52.718198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad4359-8ceb-4644-9c85-dba9a8b869e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:52.736790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3aad4359-8ceb-4644-9c85-dba9a8b869e7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:52.737973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3aad4359-8ceb-4644-9c85-dba9a8b869e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:52.777897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 156/311] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Aug 22 15:36:52 2022] PUT /identity/v3/system/users/ff392bde79824d7fab4bf3b9ed3956bb/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:36:52.811455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:52.821511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 156/312] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:53.096659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1600f-cde5-4d3c-b95a-37feb5754afb None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:53.148584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:53.205506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1600f-cde5-4d3c-b95a-37feb5754afb None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:53.241620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565a8f5-5690-4a8c-9867-4f969e4f5ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:53.242265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565a8f5-5690-4a8c-9867-4f969e4f5ba6 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:53.242546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565a8f5-5690-4a8c-9867-4f969e4f5ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:53.242818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565a8f5-5690-4a8c-9867-4f969e4f5ba6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:53.254464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565a8f5-5690-4a8c-9867-4f969e4f5ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-5565a8f5-5690-4a8c-9867-4f969e4f5ba6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:53.259823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:53.260774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:53.261585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 157/313] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:53.269967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad4359-8ceb-4644-9c85-dba9a8b869e7 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:53.376349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad4359-8ceb-4644-9c85-dba9a8b869e7 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:53.413089 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f1f00-0889-4860-8af5-55434c5b0403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:53.413701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1f00-0889-4860-8af5-55434c5b0403 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:53.413975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1f00-0889-4860-8af5-55434c5b0403 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:53.414243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1f00-0889-4860-8af5-55434c5b0403 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:53.414897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f1f00-0889-4860-8af5-55434c5b0403 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:53.415196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f1f00-0889-4860-8af5-55434c5b0403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:53.416589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f1f00-0889-4860-8af5-55434c5b0403 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:53.429402 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 157/314] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:53.431431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565a8f5-5690-4a8c-9867-4f969e4f5ba6 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:53.540391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565a8f5-5690-4a8c-9867-4f969e4f5ba6 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:53.550420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:53.576549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a98e7-2d04-42c8-a0fb-c4d4c591e26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:53.577177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a98e7-2d04-42c8-a0fb-c4d4c591e26d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:53.577499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a98e7-2d04-42c8-a0fb-c4d4c591e26d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:53.577773 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a98e7-2d04-42c8-a0fb-c4d4c591e26d None admin] PATH_INFO: `/v3/users/f30464b32b7f49ff9422de68c57f65b1` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:53.578954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a98e7-2d04-42c8-a0fb-c4d4c591e26d None admin] RBAC: Authorizing `identity:get_user(user_id=f30464b32b7f49ff9422de68c57f65b1)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:53.580387 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a98e7-2d04-42c8-a0fb-c4d4c591e26d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:53.586930 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 158/315] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:53 2022] GET /identity/v3/users/f30464b32b7f49ff9422de68c57f65b1 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:53.588194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f1f00-0889-4860-8af5-55434c5b0403 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:53.654844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:53.703475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f1f00-0889-4860-8af5-55434c5b0403 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:53.738083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4d824-8fe3-44e4-b921-7dc00ff22f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:53.739489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4d824-8fe3-44e4-b921-7dc00ff22f97 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:53.739920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4d824-8fe3-44e4-b921-7dc00ff22f97 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:53.740343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4d824-8fe3-44e4-b921-7dc00ff22f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:53.814701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4d824-8fe3-44e4-b921-7dc00ff22f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:53.816419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4d824-8fe3-44e4-b921-7dc00ff22f97 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:53.875832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:53.923221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 158/316] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:53.929747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a98e7-2d04-42c8-a0fb-c4d4c591e26d None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:54.036960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a98e7-2d04-42c8-a0fb-c4d4c591e26d None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:54.072704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe4d55-f0d6-480b-ac91-a6a74eda6de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:54.073962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4d55-f0d6-480b-ac91-a6a74eda6de8 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:54.074245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4d55-f0d6-480b-ac91-a6a74eda6de8 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:54.074513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4d55-f0d6-480b-ac91-a6a74eda6de8 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:54.075714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe4d55-f0d6-480b-ac91-a6a74eda6de8 None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:54.077190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe4d55-f0d6-480b-ac91-a6a74eda6de8 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:54.079304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 159/317] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:53 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:54.085279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4d824-8fe3-44e4-b921-7dc00ff22f97 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:54.189981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4d824-8fe3-44e4-b921-7dc00ff22f97 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:54.229520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659df6d9-ed53-410a-8875-047d32937dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:54.230139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659df6d9-ed53-410a-8875-047d32937dfd None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:54.230417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659df6d9-ed53-410a-8875-047d32937dfd None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:54.230683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659df6d9-ed53-410a-8875-047d32937dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:54.231414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659df6d9-ed53-410a-8875-047d32937dfd None admin] RBAC: Adding query filter params (role.id=0be962a218de4ebd87c3062a16459c98, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b, user.id=f30464b32b7f49ff9422de68c57f65b1) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:54.231757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659df6d9-ed53-410a-8875-047d32937dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:54.233244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659df6d9-ed53-410a-8875-047d32937dfd None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:54.239991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 159/318] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:36:54 2022] GET /identity/v3/role_assignments?user.id=f30464b32b7f49ff9422de68c57f65b1&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=0be962a218de4ebd87c3062a16459c98 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:54.249193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9318f-d01e-47d6-abdd-bba8d8e37883 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:54.249742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9318f-d01e-47d6-abdd-bba8d8e37883 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:54.249742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9318f-d01e-47d6-abdd-bba8d8e37883 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:54.251396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 160/319] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:54.257336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3fba1-b4f8-4e92-af43-a2524df408c1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:54.257793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3fba1-b4f8-4e92-af43-a2524df408c1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:54.258207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3fba1-b4f8-4e92-af43-a2524df408c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:54.284478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-dbe3fba1-b4f8-4e92-af43-a2524df408c1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:54.285730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-dbe3fba1-b4f8-4e92-af43-a2524df408c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:54.302969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:54.368804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 160/320] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:54.564098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f45bc-92cf-4eb0-9297-d424718beed7 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:54.564380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f45bc-92cf-4eb0-9297-d424718beed7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:54.564821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f45bc-92cf-4eb0-9297-d424718beed7 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:54.566272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 161/321] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:54.572314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7389c-5a54-4ba1-99b4-c67f415cc313 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:54.572617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7389c-5a54-4ba1-99b4-c67f415cc313 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:54.572884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7389c-5a54-4ba1-99b4-c67f415cc313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:54.592705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-75d7389c-5a54-4ba1-99b4-c67f415cc313 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:54.593882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-75d7389c-5a54-4ba1-99b4-c67f415cc313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:54.639437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f45bc-92cf-4eb0-9297-d424718beed7 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:54.678543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 161/322] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:54.688897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:54.757597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f45bc-92cf-4eb0-9297-d424718beed7 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:54.796997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7afeb3-08b6-41c1-9292-bba8831aedc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:54.797723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7afeb3-08b6-41c1-9292-bba8831aedc7 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:54.798087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7afeb3-08b6-41c1-9292-bba8831aedc7 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:54.798439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7afeb3-08b6-41c1-9292-bba8831aedc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:54.799994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7afeb3-08b6-41c1-9292-bba8831aedc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:54.801896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7afeb3-08b6-41c1-9292-bba8831aedc7 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:54.803687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 162/323] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:36:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:54.807623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a67677-eb16-4771-a3d7-e60903f62d80 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:54.808177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a67677-eb16-4771-a3d7-e60903f62d80 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:54.808328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a67677-eb16-4771-a3d7-e60903f62d80 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:54.809588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7afeb3-08b6-41c1-9292-bba8831aedc7 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:54.809711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 162/324] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:54.816320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44a95-9020-4f06-9e35-588722a75eaf None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:54.816611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44a95-9020-4f06-9e35-588722a75eaf None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:54.816824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44a95-9020-4f06-9e35-588722a75eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:54.841514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3ef44a95-9020-4f06-9e35-588722a75eaf None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:54.842723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3ef44a95-9020-4f06-9e35-588722a75eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:54.944493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 163/325] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:54.946304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7afeb3-08b6-41c1-9292-bba8831aedc7 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:54.956929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:54.976160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44a95-9020-4f06-9e35-588722a75eaf None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:54.987174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadecbf-4881-4cda-85ac-98c0c870e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:54.987789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadecbf-4881-4cda-85ac-98c0c870e50d None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:54.988062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadecbf-4881-4cda-85ac-98c0c870e50d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:54.988327 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadecbf-4881-4cda-85ac-98c0c870e50d None admin] PATH_INFO: `/v3/groups` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:54.989169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadecbf-4881-4cda-85ac-98c0c870e50d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:54.990099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:54.991054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadecbf-4881-4cda-85ac-98c0c870e50d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:55.084966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44a95-9020-4f06-9e35-588722a75eaf None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:55.124434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceb7a1-2fe8-4179-8682-9843f0a2214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:55.125106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceb7a1-2fe8-4179-8682-9843f0a2214e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:55.125413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceb7a1-2fe8-4179-8682-9843f0a2214e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:55.125659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceb7a1-2fe8-4179-8682-9843f0a2214e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:55.136924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 163/326] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Aug 22 15:36:54 2022] POST /identity/v3/groups => generated 226 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:36:55.153870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eceb7a1-2fe8-4179-8682-9843f0a2214e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-6eceb7a1-2fe8-4179-8682-9843f0a2214e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:55.159446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:55.160539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:55.161561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 164/327] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:36:55.166865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadecbf-4881-4cda-85ac-98c0c870e50d None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:55.221224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceb7a1-2fe8-4179-8682-9843f0a2214e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:55.328936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadecbf-4881-4cda-85ac-98c0c870e50d None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:55.342270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:55.372329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6b319-93d9-48ee-975c-49f407a1f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:55.373412 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6b319-93d9-48ee-975c-49f407a1f29f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:55.373872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6b319-93d9-48ee-975c-49f407a1f29f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:55.374189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6b319-93d9-48ee-975c-49f407a1f29f None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:55.375112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6b319-93d9-48ee-975c-49f407a1f29f None admin] RBAC: Adding query filter params (name=reader) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:55.375631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6b319-93d9-48ee-975c-49f407a1f29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:55.378155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6b319-93d9-48ee-975c-49f407a1f29f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:55.396565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 164/328] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:55.399294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6b319-93d9-48ee-975c-49f407a1f29f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:55.400142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceb7a1-2fe8-4179-8682-9843f0a2214e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:55.444361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:55.446169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a21805-98df-479c-bdbd-b7d113ed4683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:55.446825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a21805-98df-479c-bdbd-b7d113ed4683 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:55.447098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a21805-98df-479c-bdbd-b7d113ed4683 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:55.447368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a21805-98df-479c-bdbd-b7d113ed4683 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:55.463259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a21805-98df-479c-bdbd-b7d113ed4683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-b9a21805-98df-479c-bdbd-b7d113ed4683 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:55.470438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:55.471414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:55.472214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:55.477334 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 165/329] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:36:55.480904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a21805-98df-479c-bdbd-b7d113ed4683 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:55.550966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6b319-93d9-48ee-975c-49f407a1f29f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:55.604229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556f856-06e1-49e0-9f37-46abc39e31cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:55.604837 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f856-06e1-49e0-9f37-46abc39e31cd None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:55.605117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f856-06e1-49e0-9f37-46abc39e31cd None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:55.605403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f856-06e1-49e0-9f37-46abc39e31cd None admin] PATH_INFO: `/v3/users/a6f08d42b22d4d1fa234140a3c3f79f2` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:55.606586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556f856-06e1-49e0-9f37-46abc39e31cd None admin] RBAC: Authorizing `identity:get_user(user_id=a6f08d42b22d4d1fa234140a3c3f79f2)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:55.608019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556f856-06e1-49e0-9f37-46abc39e31cd None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:55.610454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 165/330] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:55 2022] GET /identity/v3/users/a6f08d42b22d4d1fa234140a3c3f79f2 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:55.616705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556f856-06e1-49e0-9f37-46abc39e31cd None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:55.626812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a21805-98df-479c-bdbd-b7d113ed4683 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:55.668300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:55.677328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e9a6b-90fb-41f8-b826-64f4ab5ffa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:55.678287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e9a6b-90fb-41f8-b826-64f4ab5ffa9d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:55.684848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e9a6b-90fb-41f8-b826-64f4ab5ffa9d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:55.684848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e9a6b-90fb-41f8-b826-64f4ab5ffa9d None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:55.684848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e9a6b-90fb-41f8-b826-64f4ab5ffa9d None admin] RBAC: Adding query filter params (name=member) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:55.684848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e9a6b-90fb-41f8-b826-64f4ab5ffa9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:55.684848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e9a6b-90fb-41f8-b826-64f4ab5ffa9d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:55.694314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 166/331] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:36:55.701711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e9a6b-90fb-41f8-b826-64f4ab5ffa9d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:55.761347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:55.765112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556f856-06e1-49e0-9f37-46abc39e31cd None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:55.878619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fb49c-c041-4b8d-8c53-5e4a79fea5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:55.879731 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fb49c-c041-4b8d-8c53-5e4a79fea5af None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:55.880209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fb49c-c041-4b8d-8c53-5e4a79fea5af None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:55.880734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fb49c-c041-4b8d-8c53-5e4a79fea5af None admin] PATH_INFO: `/v3/system/users/a6f08d42b22d4d1fa234140a3c3f79f2/roles/0be962a218de4ebd87c3062a16459c98` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:55.882521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fb49c-c041-4b8d-8c53-5e4a79fea5af None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6f08d42b22d4d1fa234140a3c3f79f2, role_id=0be962a218de4ebd87c3062a16459c98)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:55.884446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fb49c-c041-4b8d-8c53-5e4a79fea5af None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:55.931469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e9a6b-90fb-41f8-b826-64f4ab5ffa9d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:55.955941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 166/332] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Aug 22 15:36:55 2022] PUT /identity/v3/system/users/a6f08d42b22d4d1fa234140a3c3f79f2/roles/0be962a218de4ebd87c3062a16459c98 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:36:55.986140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803bb3f-4842-4065-97c3-1c0f5e821d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:55.986985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803bb3f-4842-4065-97c3-1c0f5e821d84 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:55.987423 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803bb3f-4842-4065-97c3-1c0f5e821d84 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:55.987828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803bb3f-4842-4065-97c3-1c0f5e821d84 None admin] PATH_INFO: `/v3/users/ff392bde79824d7fab4bf3b9ed3956bb` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:55.993193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803bb3f-4842-4065-97c3-1c0f5e821d84 None admin] RBAC: Authorizing `identity:get_user(user_id=ff392bde79824d7fab4bf3b9ed3956bb)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:55.994835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803bb3f-4842-4065-97c3-1c0f5e821d84 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:55.997285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 167/333] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:36:55 2022] GET /identity/v3/users/ff392bde79824d7fab4bf3b9ed3956bb => generated 293 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:56.003034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fb49c-c041-4b8d-8c53-5e4a79fea5af None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:56.144329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fb49c-c041-4b8d-8c53-5e4a79fea5af None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:56.186942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5793d5b-54df-4ce1-92e9-ba09f099a015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:56.187680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793d5b-54df-4ce1-92e9-ba09f099a015 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:56.188036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793d5b-54df-4ce1-92e9-ba09f099a015 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:56.188382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5793d5b-54df-4ce1-92e9-ba09f099a015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:56.189479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5793d5b-54df-4ce1-92e9-ba09f099a015 None admin] RBAC: Adding query filter params (role.id=23c81c3dc8f743289ecb566849eb8324, user.id=ff392bde79824d7fab4bf3b9ed3956bb, scope.system=all) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:56.189875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5793d5b-54df-4ce1-92e9-ba09f099a015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:56.191420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5793d5b-54df-4ce1-92e9-ba09f099a015 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:56.205965 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 167/334] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Aug 22 15:36:56 2022] GET /identity/v3/role_assignments?user.id=ff392bde79824d7fab4bf3b9ed3956bb&scope.system=all&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:57.915975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06a62-e442-4b06-9335-d3d54e97540e None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:57.917429 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06a62-e442-4b06-9335-d3d54e97540e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:57.922392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06a62-e442-4b06-9335-d3d54e97540e None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:57.924912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 168/335] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:57.930834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925744-10d9-4253-bbb0-8385cc40c654 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:57.931559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925744-10d9-4253-bbb0-8385cc40c654 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:57.931559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925744-10d9-4253-bbb0-8385cc40c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:57.964333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b9925744-10d9-4253-bbb0-8385cc40c654 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:57.966041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b9925744-10d9-4253-bbb0-8385cc40c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:57.992234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:58.052939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 168/336] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:58.270461 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c918ad-6558-4312-a1f8-7ab2edf00597 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:58.270748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c918ad-6558-4312-a1f8-7ab2edf00597 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:58.271013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c918ad-6558-4312-a1f8-7ab2edf00597 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:58.272633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 169/337] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:58.278311 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501022e-3f16-41b5-b80d-4a16123b4d3d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:58.278601 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501022e-3f16-41b5-b80d-4a16123b4d3d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:58.278882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501022e-3f16-41b5-b80d-4a16123b4d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:58.299819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c501022e-3f16-41b5-b80d-4a16123b4d3d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:58.301109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c501022e-3f16-41b5-b80d-4a16123b4d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:58.394760 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 169/338] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:58.526048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c918ad-6558-4312-a1f8-7ab2edf00597 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:58.605776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:58.638887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1cde8-cee4-4ade-82f1-b4feb02cc361 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:58.639162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1cde8-cee4-4ade-82f1-b4feb02cc361 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:58.639438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1cde8-cee4-4ade-82f1-b4feb02cc361 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:58.641359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 170/339] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:58.646554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee213-50c9-4d19-ab4f-6e70cd9c230a None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:58.646839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee213-50c9-4d19-ab4f-6e70cd9c230a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:58.647106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcee213-50c9-4d19-ab4f-6e70cd9c230a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:58.683819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c918ad-6558-4312-a1f8-7ab2edf00597 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:58.686439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4bcee213-50c9-4d19-ab4f-6e70cd9c230a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:58.687900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4bcee213-50c9-4d19-ab4f-6e70cd9c230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:58.746879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb0cda-65cf-49ba-8c12-21ed39375d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:58.747533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb0cda-65cf-49ba-8c12-21ed39375d51 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:58.747811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb0cda-65cf-49ba-8c12-21ed39375d51 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:58.748083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb0cda-65cf-49ba-8c12-21ed39375d51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:58.764142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb0cda-65cf-49ba-8c12-21ed39375d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-a1bb0cda-65cf-49ba-8c12-21ed39375d51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:58.771084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:58.772365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:58.773416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 170/340] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:58.777570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb0cda-65cf-49ba-8c12-21ed39375d51 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:58.816713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 171/341] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:36:58.934299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb0cda-65cf-49ba-8c12-21ed39375d51 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:58.971764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:59.003865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f3b04-a130-4d76-9eba-ae2c61653ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:59.004912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f3b04-a130-4d76-9eba-ae2c61653ed5 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:59.005440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f3b04-a130-4d76-9eba-ae2c61653ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:59.005911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f3b04-a130-4d76-9eba-ae2c61653ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:59.007206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f3b04-a130-4d76-9eba-ae2c61653ed5 None admin] RBAC: Adding query filter params (name=member) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:59.008278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f3b04-a130-4d76-9eba-ae2c61653ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:59.011902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f3b04-a130-4d76-9eba-ae2c61653ed5 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:59.030540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 171/342] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:36:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:59.039646 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcee213-50c9-4d19-ab4f-6e70cd9c230a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:59.063438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:59.114138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f3b04-a130-4d76-9eba-ae2c61653ed5 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:59.171209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcee213-50c9-4d19-ab4f-6e70cd9c230a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:59.219513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b7c38-1cda-46d9-81ab-d35dc96f7d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:59.220144 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b7c38-1cda-46d9-81ab-d35dc96f7d34 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:59.220605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b7c38-1cda-46d9-81ab-d35dc96f7d34 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:59.220892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b7c38-1cda-46d9-81ab-d35dc96f7d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:59.280109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f3b04-a130-4d76-9eba-ae2c61653ed5 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:59.317639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b7c38-1cda-46d9-81ab-d35dc96f7d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:59.319032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b7c38-1cda-46d9-81ab-d35dc96f7d34 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:59.331594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbcd79-022f-488e-83b2-66e239d30add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:59.332744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbcd79-022f-488e-83b2-66e239d30add None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:59.333042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbcd79-022f-488e-83b2-66e239d30add None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:59.333312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbcd79-022f-488e-83b2-66e239d30add None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:59.334302 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:59.349888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbcd79-022f-488e-83b2-66e239d30add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-d1dbcd79-022f-488e-83b2-66e239d30add None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:59.357668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:59.371151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 172/343] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:36:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:36:59.372010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601ca6-c7aa-4f80-b4d3-69059acbcee6 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:59.372789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601ca6-c7aa-4f80-b4d3-69059acbcee6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:59.372789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9601ca6-c7aa-4f80-b4d3-69059acbcee6 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:59.372789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 173/344] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:36:59.372789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9601ca6-c7aa-4f80-b4d3-69059acbcee6 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:59.476163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 172/345] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:36:59.477548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043634fd-77a8-4a3e-971c-80651c2f8f41 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:59.477842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043634fd-77a8-4a3e-971c-80651c2f8f41 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:59.478109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043634fd-77a8-4a3e-971c-80651c2f8f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:59.478438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:59.505338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-043634fd-77a8-4a3e-971c-80651c2f8f41 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:36:59.506543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-043634fd-77a8-4a3e-971c-80651c2f8f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:36:59.510103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9601ca6-c7aa-4f80-b4d3-69059acbcee6 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:59.549767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fe6e9-1bc4-4eb6-aa4e-d7cf88859c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:59.550500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fe6e9-1bc4-4eb6-aa4e-d7cf88859c95 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:59.550780 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fe6e9-1bc4-4eb6-aa4e-d7cf88859c95 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:59.551053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fe6e9-1bc4-4eb6-aa4e-d7cf88859c95 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:59.551757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fe6e9-1bc4-4eb6-aa4e-d7cf88859c95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:36:59.552162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fe6e9-1bc4-4eb6-aa4e-d7cf88859c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:59.553596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fe6e9-1bc4-4eb6-aa4e-d7cf88859c95 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:59.565901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 174/346] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:36:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:59.566987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fe6e9-1bc4-4eb6-aa4e-d7cf88859c95 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:59.581368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 173/347] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:36:59.582170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043634fd-77a8-4a3e-971c-80651c2f8f41 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:59.652912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:59.684192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fe6e9-1bc4-4eb6-aa4e-d7cf88859c95 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:59.704292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:59.731954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835496-5898-496c-ac6e-c394d7a8435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:59.732641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835496-5898-496c-ac6e-c394d7a8435b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:59.732924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835496-5898-496c-ac6e-c394d7a8435b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:59.733198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835496-5898-496c-ac6e-c394d7a8435b None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:59.734773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f835496-5898-496c-ac6e-c394d7a8435b None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:36:59.736257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f835496-5898-496c-ac6e-c394d7a8435b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:36:59.738263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 175/348] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:36:59 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:36:59.738887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835496-5898-496c-ac6e-c394d7a8435b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:59.758749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043634fd-77a8-4a3e-971c-80651c2f8f41 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:59.807395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533dda4-c44e-4190-9426-a10f57e3c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:59.808043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533dda4-c44e-4190-9426-a10f57e3c0f8 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:59.808384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533dda4-c44e-4190-9426-a10f57e3c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:59.808686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533dda4-c44e-4190-9426-a10f57e3c0f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:59.823560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533dda4-c44e-4190-9426-a10f57e3c0f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-7533dda4-c44e-4190-9426-a10f57e3c0f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:36:59.830527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:36:59.831515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:36:59.832345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 174/349] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:36:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:36:59.833086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533dda4-c44e-4190-9426-a10f57e3c0f8 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:36:59.871633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835496-5898-496c-ac6e-c394d7a8435b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:36:59.930141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ff9a3-6f30-4150-b385-3a0bdb430253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:36:59.931507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ff9a3-6f30-4150-b385-3a0bdb430253 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:36:59.931944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ff9a3-6f30-4150-b385-3a0bdb430253 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:36:59.932788 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ff9a3-6f30-4150-b385-3a0bdb430253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:36:59.992867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:36:59.999757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:00.000265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533dda4-c44e-4190-9426-a10f57e3c0f8 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:00.042126 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ff9a3-6f30-4150-b385-3a0bdb430253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:00.043660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ff9a3-6f30-4150-b385-3a0bdb430253 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:00.058522 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4fe5d-49ab-4ca0-821e-4ead42f9a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:00.059153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4fe5d-49ab-4ca0-821e-4ead42f9a53e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.059430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4fe5d-49ab-4ca0-821e-4ead42f9a53e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.059695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4fe5d-49ab-4ca0-821e-4ead42f9a53e None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.067736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4fe5d-49ab-4ca0-821e-4ead42f9a53e None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:00.069263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4fe5d-49ab-4ca0-821e-4ead42f9a53e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:00.070968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 175/350] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:36:59 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:00.071749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4fe5d-49ab-4ca0-821e-4ead42f9a53e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:00.172816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 176/351] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:36:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:00.174368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72aaca-f3eb-4475-9cc8-c49de74010e6 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.174724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72aaca-f3eb-4475-9cc8-c49de74010e6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.174994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72aaca-f3eb-4475-9cc8-c49de74010e6 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.176397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 177/352] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:00.177350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac984757-a434-48d4-815c-2b26b5cab73e None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.177624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac984757-a434-48d4-815c-2b26b5cab73e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.177939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac984757-a434-48d4-815c-2b26b5cab73e None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.180553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 178/353] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:00.180553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac984757-a434-48d4-815c-2b26b5cab73e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:00.204037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4fe5d-49ab-4ca0-821e-4ead42f9a53e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:00.246930 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f3575-58f1-418f-a039-34b8090f2314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:00.250095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f3575-58f1-418f-a039-34b8090f2314 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.250095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f3575-58f1-418f-a039-34b8090f2314 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.250095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f3575-58f1-418f-a039-34b8090f2314 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.250095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f3575-58f1-418f-a039-34b8090f2314 None admin] RBAC: Adding query filter params (name=member) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:00.250095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f3575-58f1-418f-a039-34b8090f2314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:00.250505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f3575-58f1-418f-a039-34b8090f2314 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:00.260196 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 176/354] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:37:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:00.261067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f3575-58f1-418f-a039-34b8090f2314 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:00.271553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:00.296489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:00.312661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac984757-a434-48d4-815c-2b26b5cab73e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:00.357554 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3aa6f-e24e-44e0-babd-d96b67cce35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:00.358217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3aa6f-e24e-44e0-babd-d96b67cce35f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.358493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3aa6f-e24e-44e0-babd-d96b67cce35f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.358755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3aa6f-e24e-44e0-babd-d96b67cce35f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.373527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3aa6f-e24e-44e0-babd-d96b67cce35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-1cf3aa6f-e24e-44e0-babd-d96b67cce35f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:00.378820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:00.379742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:00.380560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 179/355] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:00.381325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3aa6f-e24e-44e0-babd-d96b67cce35f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:00.398535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f3575-58f1-418f-a039-34b8090f2314 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:00.443725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf2c40-6008-4eef-8d14-7383d3434a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:00.444268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2c40-6008-4eef-8d14-7383d3434a5c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.444572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2c40-6008-4eef-8d14-7383d3434a5c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.444850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf2c40-6008-4eef-8d14-7383d3434a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.445619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf2c40-6008-4eef-8d14-7383d3434a5c None admin] RBAC: Adding query filter params (group.id=a10648da4c5a4c489567a2c0da5063ef, role.id=23c81c3dc8f743289ecb566849eb8324, scope.project.id=ebb4d7000b48410e8173e1b4a878579a) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:00.445900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf2c40-6008-4eef-8d14-7383d3434a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:00.447371 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf2c40-6008-4eef-8d14-7383d3434a5c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:00.454121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 177/356] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 15:37:00 2022] GET /identity/v3/role_assignments?group.id=a10648da4c5a4c489567a2c0da5063ef&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:00.455509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8381-1a2b-4908-ab09-d19aef0b6501 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.455791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8381-1a2b-4908-ab09-d19aef0b6501 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.456064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a8381-1a2b-4908-ab09-d19aef0b6501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.478259 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-da9a8381-1a2b-4908-ab09-d19aef0b6501 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:00.479062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-da9a8381-1a2b-4908-ab09-d19aef0b6501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:00.540561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3aa6f-e24e-44e0-babd-d96b67cce35f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:00.575536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 178/357] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:00.577040 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af5a7-1fc4-45a1-bb94-99b6778b2130 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.577477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af5a7-1fc4-45a1-bb94-99b6778b2130 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.577738 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2af5a7-1fc4-45a1-bb94-99b6778b2130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.589536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:00.598925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718586b-2da4-48e9-ba02-daaf97a8f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:00.599592 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718586b-2da4-48e9-ba02-daaf97a8f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.599870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718586b-2da4-48e9-ba02-daaf97a8f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.604951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718586b-2da4-48e9-ba02-daaf97a8f3c7 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.604951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718586b-2da4-48e9-ba02-daaf97a8f3c7 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:00.604951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718586b-2da4-48e9-ba02-daaf97a8f3c7 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:00.605600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 180/358] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:00 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:00.606591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718586b-2da4-48e9-ba02-daaf97a8f3c7 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:00.608671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-6c2af5a7-1fc4-45a1-bb94-99b6778b2130 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:00.609972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6c2af5a7-1fc4-45a1-bb94-99b6778b2130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:00.627177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:00.693243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 179/359] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:00.694089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af5a7-1fc4-45a1-bb94-99b6778b2130 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:00.773468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718586b-2da4-48e9-ba02-daaf97a8f3c7 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:00.846370 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221888a9-4b7b-4ca6-8d6d-cac239d46787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:00.846996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221888a9-4b7b-4ca6-8d6d-cac239d46787 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.847269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221888a9-4b7b-4ca6-8d6d-cac239d46787 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.847533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221888a9-4b7b-4ca6-8d6d-cac239d46787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.879244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2af5a7-1fc4-45a1-bb94-99b6778b2130 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:00.933245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada78ed-834c-45dc-b6f7-9395c3101571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:00.933943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada78ed-834c-45dc-b6f7-9395c3101571 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:00.934231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada78ed-834c-45dc-b6f7-9395c3101571 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:00.934510 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada78ed-834c-45dc-b6f7-9395c3101571 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:00.935575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada78ed-834c-45dc-b6f7-9395c3101571 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:00.935890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada78ed-834c-45dc-b6f7-9395c3101571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:00.938015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada78ed-834c-45dc-b6f7-9395c3101571 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:00.950353 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 180/360] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:37:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:00.951169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada78ed-834c-45dc-b6f7-9395c3101571 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:00.977428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:00.979865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:00.985474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221888a9-4b7b-4ca6-8d6d-cac239d46787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:00.987507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221888a9-4b7b-4ca6-8d6d-cac239d46787 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:01.106028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada78ed-834c-45dc-b6f7-9395c3101571 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:01.124928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 181/361] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:01.125932 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221888a9-4b7b-4ca6-8d6d-cac239d46787 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:01.152401 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79cd3d-9663-41cd-8bbc-8df2478e4ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:01.153104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79cd3d-9663-41cd-8bbc-8df2478e4ca4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:01.153378 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79cd3d-9663-41cd-8bbc-8df2478e4ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:01.153649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79cd3d-9663-41cd-8bbc-8df2478e4ca4 None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:01.154978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79cd3d-9663-41cd-8bbc-8df2478e4ca4 None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:01.156479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79cd3d-9663-41cd-8bbc-8df2478e4ca4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:01.158114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 181/362] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:00 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:01.158977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79cd3d-9663-41cd-8bbc-8df2478e4ca4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:01.264677 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:01.268037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:01.269542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221888a9-4b7b-4ca6-8d6d-cac239d46787 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:01.294373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79cd3d-9663-41cd-8bbc-8df2478e4ca4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:01.337866 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929789d1-da68-4294-b6e2-ec88d772a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:01.338579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929789d1-da68-4294-b6e2-ec88d772a601 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:01.338862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929789d1-da68-4294-b6e2-ec88d772a601 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:01.339137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929789d1-da68-4294-b6e2-ec88d772a601 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:01.350585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac37fc-71df-48ec-80d2-2df6a7aa804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:01.351539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac37fc-71df-48ec-80d2-2df6a7aa804d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:01.351778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929789d1-da68-4294-b6e2-ec88d772a601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:01.351973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac37fc-71df-48ec-80d2-2df6a7aa804d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:01.352395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac37fc-71df-48ec-80d2-2df6a7aa804d None admin] PATH_INFO: `/v3/users/a6f08d42b22d4d1fa234140a3c3f79f2` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:01.354439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac37fc-71df-48ec-80d2-2df6a7aa804d None admin] RBAC: Authorizing `identity:get_user(user_id=a6f08d42b22d4d1fa234140a3c3f79f2)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-929789d1-da68-4294-b6e2-ec88d772a601 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:01.356845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:01.357894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:01.358820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:01.359443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac37fc-71df-48ec-80d2-2df6a7aa804d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:01.359512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 182/363] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:37:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:01.359512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929789d1-da68-4294-b6e2-ec88d772a601 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:01.363097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 182/364] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:37:01 2022] GET /identity/v3/users/a6f08d42b22d4d1fa234140a3c3f79f2 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:01.364872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac37fc-71df-48ec-80d2-2df6a7aa804d None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:01.543363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929789d1-da68-4294-b6e2-ec88d772a601 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:01.554139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac37fc-71df-48ec-80d2-2df6a7aa804d None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:01.599031 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1dd1d-4f17-44a9-b092-6ced99114f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:01.600004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1dd1d-4f17-44a9-b092-6ced99114f89 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:01.600311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1dd1d-4f17-44a9-b092-6ced99114f89 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:01.601071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1dd1d-4f17-44a9-b092-6ced99114f89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:01.615009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f63e3-be6e-4a21-bcff-568d49f81991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:01.615285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1dd1d-4f17-44a9-b092-6ced99114f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:01.616142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f63e3-be6e-4a21-bcff-568d49f81991 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:01.616423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f63e3-be6e-4a21-bcff-568d49f81991 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:01.616772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f63e3-be6e-4a21-bcff-568d49f81991 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:01.617963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f63e3-be6e-4a21-bcff-568d49f81991 None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:01.619473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f63e3-be6e-4a21-bcff-568d49f81991 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-4cc1dd1d-4f17-44a9-b092-6ced99114f89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:01.620478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:01.621719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:01.622561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:01.623732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 183/365] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:01 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:01.623732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f63e3-be6e-4a21-bcff-568d49f81991 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:01.623857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 183/366] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:01.623857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1dd1d-4f17-44a9-b092-6ced99114f89 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:01.649590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:01.652078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:01.769360 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1dd1d-4f17-44a9-b092-6ced99114f89 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:01.805164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f63e3-be6e-4a21-bcff-568d49f81991 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:01.817851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff225-9e40-44ae-a50c-4894b0a8398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:01.818483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff225-9e40-44ae-a50c-4894b0a8398c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:01.818767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff225-9e40-44ae-a50c-4894b0a8398c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:01.819049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ff225-9e40-44ae-a50c-4894b0a8398c None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:01.819754 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ff225-9e40-44ae-a50c-4894b0a8398c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:01.820060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ff225-9e40-44ae-a50c-4894b0a8398c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:01.823238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ff225-9e40-44ae-a50c-4894b0a8398c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:01.835107 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 184/367] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:01.835836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff225-9e40-44ae-a50c-4894b0a8398c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:01.864461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ae428-5bf6-47a1-ba73-149c70e3ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:01.865566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ae428-5bf6-47a1-ba73-149c70e3ab60 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:01.866065 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ae428-5bf6-47a1-ba73-149c70e3ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:01.866655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ae428-5bf6-47a1-ba73-149c70e3ab60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:01.867772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ae428-5bf6-47a1-ba73-149c70e3ab60 None admin] RBAC: Adding query filter params (group.id=a10648da4c5a4c489567a2c0da5063ef, role.id=e5562064df7e4f1a96a35d581b4f28c4, scope.project.id=ebb4d7000b48410e8173e1b4a878579a) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:01.868234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ae428-5bf6-47a1-ba73-149c70e3ab60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:01.873789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ae428-5bf6-47a1-ba73-149c70e3ab60 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:01.880608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 184/368] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 15:37:01 2022] GET /identity/v3/role_assignments?group.id=a10648da4c5a4c489567a2c0da5063ef&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=e5562064df7e4f1a96a35d581b4f28c4 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:01.881480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ae428-5bf6-47a1-ba73-149c70e3ab60 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:01.995875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:02.022817 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ff225-9e40-44ae-a50c-4894b0a8398c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:02.040287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:02.072094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ae428-5bf6-47a1-ba73-149c70e3ab60 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:02.091559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267d3e1-f610-4cf7-9859-420e42d6ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:02.093401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d3e1-f610-4cf7-9859-420e42d6ec02 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:02.093401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d3e1-f610-4cf7-9859-420e42d6ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:02.093401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267d3e1-f610-4cf7-9859-420e42d6ec02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:02.093695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267d3e1-f610-4cf7-9859-420e42d6ec02 None admin] RBAC: Adding query filter params (role.id=0be962a218de4ebd87c3062a16459c98, user.id=a6f08d42b22d4d1fa234140a3c3f79f2, scope.system=all) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:02.094102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267d3e1-f610-4cf7-9859-420e42d6ec02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:02.095598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267d3e1-f610-4cf7-9859-420e42d6ec02 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:02.115243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 185/369] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Aug 22 15:37:01 2022] GET /identity/v3/role_assignments?user.id=a6f08d42b22d4d1fa234140a3c3f79f2&scope.system=all&role.id=0be962a218de4ebd87c3062a16459c98 => generated 510 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:02.116021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267d3e1-f610-4cf7-9859-420e42d6ec02 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:02.160150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c33a0-ffe3-4e89-911c-8c2798bc108f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:02.162255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c33a0-ffe3-4e89-911c-8c2798bc108f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:02.162958 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c33a0-ffe3-4e89-911c-8c2798bc108f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:02.168551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c33a0-ffe3-4e89-911c-8c2798bc108f None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:02.171283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c33a0-ffe3-4e89-911c-8c2798bc108f None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:02.174557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c33a0-ffe3-4e89-911c-8c2798bc108f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:02.178472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 185/370] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:01 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:02.186304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c33a0-ffe3-4e89-911c-8c2798bc108f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:02.239419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267d3e1-f610-4cf7-9859-420e42d6ec02 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:02.281963 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910c81-8a28-48d1-8a8d-c7a07024c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:02.282661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910c81-8a28-48d1-8a8d-c7a07024c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:02.282943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910c81-8a28-48d1-8a8d-c7a07024c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:02.283208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910c81-8a28-48d1-8a8d-c7a07024c0e2 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:02.283874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81910c81-8a28-48d1-8a8d-c7a07024c0e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:02.284173 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81910c81-8a28-48d1-8a8d-c7a07024c0e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:02.288546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81910c81-8a28-48d1-8a8d-c7a07024c0e2 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:02.296659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 186/371] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:02.297928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910c81-8a28-48d1-8a8d-c7a07024c0e2 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:02.301386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:02.422221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910c81-8a28-48d1-8a8d-c7a07024c0e2 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:02.450248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c33a0-ffe3-4e89-911c-8c2798bc108f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:02.466783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133171f-452e-4d38-9cdd-f8e3f900eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:02.467408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133171f-452e-4d38-9cdd-f8e3f900eefc None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:02.467683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133171f-452e-4d38-9cdd-f8e3f900eefc None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:02.467952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133171f-452e-4d38-9cdd-f8e3f900eefc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:02.471710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133171f-452e-4d38-9cdd-f8e3f900eefc None admin] RBAC: Adding query filter params (group.id=a10648da4c5a4c489567a2c0da5063ef, role.id=23c81c3dc8f743289ecb566849eb8324, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:02.472077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133171f-452e-4d38-9cdd-f8e3f900eefc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:02.473580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133171f-452e-4d38-9cdd-f8e3f900eefc None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:02.484007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 187/372] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 15:37:02 2022] GET /identity/v3/role_assignments?group.id=a10648da4c5a4c489567a2c0da5063ef&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:02.485053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133171f-452e-4d38-9cdd-f8e3f900eefc None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:02.502064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a6457-fe5c-43ad-86f9-a072a96f0d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:02.503387 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6457-fe5c-43ad-86f9-a072a96f0d05 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:02.504163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6457-fe5c-43ad-86f9-a072a96f0d05 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:02.504700 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a6457-fe5c-43ad-86f9-a072a96f0d05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:02.546075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:02.633227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:02.673950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a6457-fe5c-43ad-86f9-a072a96f0d05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:02.676267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a6457-fe5c-43ad-86f9-a072a96f0d05 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:02.702045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133171f-452e-4d38-9cdd-f8e3f900eefc None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:02.766271 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c4f8e-a7d3-47bf-8800-0ffd93e97dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:02.767228 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c4f8e-a7d3-47bf-8800-0ffd93e97dd6 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:02.767696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c4f8e-a7d3-47bf-8800-0ffd93e97dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:02.768168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c4f8e-a7d3-47bf-8800-0ffd93e97dd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:02.876241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c4f8e-a7d3-47bf-8800-0ffd93e97dd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:02.878238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c4f8e-a7d3-47bf-8800-0ffd93e97dd6 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:02.892213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 186/373] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:02.893922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719b75-1ee7-493b-a3b9-836442836466 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:02.894220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719b75-1ee7-493b-a3b9-836442836466 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:02.894479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de719b75-1ee7-493b-a3b9-836442836466 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:02.896226 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 187/374] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:02.901911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de719b75-1ee7-493b-a3b9-836442836466 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:03.021107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:03.029200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:03.104363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 188/375] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:03.110214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985529e-0479-48a2-a6f7-07a81296c43a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:03.110595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985529e-0479-48a2-a6f7-07a81296c43a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:03.110766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985529e-0479-48a2-a6f7-07a81296c43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:03.131232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de719b75-1ee7-493b-a3b9-836442836466 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:03.142440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-2985529e-0479-48a2-a6f7-07a81296c43a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:03.145232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2985529e-0479-48a2-a6f7-07a81296c43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:03.206438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb5384-ebdf-49c6-991e-1eaf099f16b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:03.208460 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb5384-ebdf-49c6-991e-1eaf099f16b9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:03.209355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb5384-ebdf-49c6-991e-1eaf099f16b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:03.210130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb5384-ebdf-49c6-991e-1eaf099f16b9 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:03.213043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb5384-ebdf-49c6-991e-1eaf099f16b9 None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:03.216734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb5384-ebdf-49c6-991e-1eaf099f16b9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:03.220835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 188/376] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:02 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:03.222579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb5384-ebdf-49c6-991e-1eaf099f16b9 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:03.312186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 189/377] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:03.320553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985529e-0479-48a2-a6f7-07a81296c43a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:03.472312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb5384-ebdf-49c6-991e-1eaf099f16b9 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:03.542896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:03.589997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4edf-9b5b-4b0c-ae37-3f492bf30339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:03.591083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4edf-9b5b-4b0c-ae37-3f492bf30339 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:03.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4edf-9b5b-4b0c-ae37-3f492bf30339 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:03.592149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4edf-9b5b-4b0c-ae37-3f492bf30339 None admin] PATH_INFO: `/v3/projects/01b431c789654fc6addb5ceef4aa5682` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:03.594144 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4edf-9b5b-4b0c-ae37-3f492bf30339 None admin] RBAC: Authorizing `identity:get_project(project_id=01b431c789654fc6addb5ceef4aa5682)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:03.598512 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4edf-9b5b-4b0c-ae37-3f492bf30339 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:03.602734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 189/378] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:03 2022] GET /identity/v3/projects/01b431c789654fc6addb5ceef4aa5682 => generated 344 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:03.610952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4edf-9b5b-4b0c-ae37-3f492bf30339 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:03.663439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:03.682780 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985529e-0479-48a2-a6f7-07a81296c43a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:03.782753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396476a4-a3ae-4d47-a64e-358940cc7c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:03.783824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396476a4-a3ae-4d47-a64e-358940cc7c54 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:03.784300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396476a4-a3ae-4d47-a64e-358940cc7c54 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:03.784801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396476a4-a3ae-4d47-a64e-358940cc7c54 None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:03.786875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396476a4-a3ae-4d47-a64e-358940cc7c54 None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:03.789709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396476a4-a3ae-4d47-a64e-358940cc7c54 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:03.801382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 190/379] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:03 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:03.802132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396476a4-a3ae-4d47-a64e-358940cc7c54 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:03.854926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4edf-9b5b-4b0c-ae37-3f492bf30339 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:03.917991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe6981-77c9-4df7-9aa2-f42cd3d711d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:03.918966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe6981-77c9-4df7-9aa2-f42cd3d711d1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:03.919254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe6981-77c9-4df7-9aa2-f42cd3d711d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:03.919559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe6981-77c9-4df7-9aa2-f42cd3d711d1 None admin] PATH_INFO: `/v3/groups/b2768c77aae14bbfad07fb77f0f8a738` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:03.930125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe6981-77c9-4df7-9aa2-f42cd3d711d1 None admin] RBAC: Authorizing `identity:get_group(group_id=b2768c77aae14bbfad07fb77f0f8a738)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:03.931669 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe6981-77c9-4df7-9aa2-f42cd3d711d1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:03.935589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 190/380] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:03 2022] GET /identity/v3/groups/b2768c77aae14bbfad07fb77f0f8a738 => generated 229 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:03.937042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe6981-77c9-4df7-9aa2-f42cd3d711d1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:03.996690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396476a4-a3ae-4d47-a64e-358940cc7c54 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:04.029934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:04.066824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15a97d-f870-4743-8024-1b7135d4c242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:04.067392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15a97d-f870-4743-8024-1b7135d4c242 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:04.067675 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15a97d-f870-4743-8024-1b7135d4c242 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:04.067949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15a97d-f870-4743-8024-1b7135d4c242 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:04.081360 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15a97d-f870-4743-8024-1b7135d4c242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-fa15a97d-f870-4743-8024-1b7135d4c242 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:04.086940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:04.089191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:37:04.090693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:04.094051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 191/381] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:04.095021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15a97d-f870-4743-8024-1b7135d4c242 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:04.127343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe6981-77c9-4df7-9aa2-f42cd3d711d1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:04.140657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:04.170616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9004a-00aa-4e52-99d4-5b599158021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:04.171286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9004a-00aa-4e52-99d4-5b599158021c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:04.171573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9004a-00aa-4e52-99d4-5b599158021c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:04.172420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9004a-00aa-4e52-99d4-5b599158021c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:04.173428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9004a-00aa-4e52-99d4-5b599158021c None admin] RBAC: Adding query filter params (group.id=a10648da4c5a4c489567a2c0da5063ef, role.id=e5562064df7e4f1a96a35d581b4f28c4, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:04.174001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9004a-00aa-4e52-99d4-5b599158021c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:04.175596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9004a-00aa-4e52-99d4-5b599158021c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:04.183362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 191/382] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 15:37:03 2022] GET /identity/v3/role_assignments?group.id=a10648da4c5a4c489567a2c0da5063ef&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=e5562064df7e4f1a96a35d581b4f28c4 => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:04.183955 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9004a-00aa-4e52-99d4-5b599158021c None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:04.345537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9004a-00aa-4e52-99d4-5b599158021c None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:04.363140 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:04.369091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15a97d-f870-4743-8024-1b7135d4c242 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:04.393407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dd6ca-4cc3-4b11-9c5a-8fa5f9399862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:04.394355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dd6ca-4cc3-4b11-9c5a-8fa5f9399862 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:04.394797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dd6ca-4cc3-4b11-9c5a-8fa5f9399862 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:04.395271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dd6ca-4cc3-4b11-9c5a-8fa5f9399862 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:04.396168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dd6ca-4cc3-4b11-9c5a-8fa5f9399862 None admin] RBAC: Adding query filter params (name=member) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:04.396879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dd6ca-4cc3-4b11-9c5a-8fa5f9399862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:04.398570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dd6ca-4cc3-4b11-9c5a-8fa5f9399862 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:04.410762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 192/383] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:37:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:04.417491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dd6ca-4cc3-4b11-9c5a-8fa5f9399862 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:04.509792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b200ed-e18a-4f3b-85cf-b56baa132594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:04.510990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b200ed-e18a-4f3b-85cf-b56baa132594 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:04.511536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b200ed-e18a-4f3b-85cf-b56baa132594 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:04.512110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b200ed-e18a-4f3b-85cf-b56baa132594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:04.514028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b200ed-e18a-4f3b-85cf-b56baa132594 None admin] RBAC: Adding query filter params (group.id=b2768c77aae14bbfad07fb77f0f8a738, role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=01b431c789654fc6addb5ceef4aa5682) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:04.514167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b200ed-e18a-4f3b-85cf-b56baa132594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:04.516904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b200ed-e18a-4f3b-85cf-b56baa132594 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:04.540254 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 192/384] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 15:37:04 2022] GET /identity/v3/role_assignments?group.id=b2768c77aae14bbfad07fb77f0f8a738&scope.project.id=01b431c789654fc6addb5ceef4aa5682&role.id=eeb6551eeb934053866fc821b511b5dd => generated 260 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:04.553714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dd6ca-4cc3-4b11-9c5a-8fa5f9399862 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:04.629012 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1181ada-05b3-4729-92d3-43f2f1322757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:04.630220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181ada-05b3-4729-92d3-43f2f1322757 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:04.631050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181ada-05b3-4729-92d3-43f2f1322757 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:04.631548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181ada-05b3-4729-92d3-43f2f1322757 None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:04.633289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1181ada-05b3-4729-92d3-43f2f1322757 None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:04.635993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1181ada-05b3-4729-92d3-43f2f1322757 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:04.638763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 193/385] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:04 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:04.647092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b200ed-e18a-4f3b-85cf-b56baa132594 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:04.800484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:04.818470 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b200ed-e18a-4f3b-85cf-b56baa132594 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:04.837654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87228241-c25d-4ed6-9740-f5fdfe53de40 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:04.838150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87228241-c25d-4ed6-9740-f5fdfe53de40 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:04.839178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87228241-c25d-4ed6-9740-f5fdfe53de40 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:04.841759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 194/386] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:04.847760 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fe9f-54c7-48d9-a744-02d7ddfffc23 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:04.848358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fe9f-54c7-48d9-a744-02d7ddfffc23 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:04.848947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206fe9f-54c7-48d9-a744-02d7ddfffc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:04.870124 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e206fe9f-54c7-48d9-a744-02d7ddfffc23 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:04.871857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e206fe9f-54c7-48d9-a744-02d7ddfffc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:04.910926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2098d-a0c6-414c-8989-450f003cc67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:04.910926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2098d-a0c6-414c-8989-450f003cc67e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:04.910926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2098d-a0c6-414c-8989-450f003cc67e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:04.910926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2098d-a0c6-414c-8989-450f003cc67e None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:04.917907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2098d-a0c6-414c-8989-450f003cc67e None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:04.919403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2098d-a0c6-414c-8989-450f003cc67e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:04.932676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 193/387] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:04 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:04.934440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2098d-a0c6-414c-8989-450f003cc67e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:04.936992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:05.006028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 195/388] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:05.067103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2098d-a0c6-414c-8989-450f003cc67e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:05.110188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c77e7-e9b5-454f-8e80-e3dca1c946bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:05.110873 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c77e7-e9b5-454f-8e80-e3dca1c946bb None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:05.111155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c77e7-e9b5-454f-8e80-e3dca1c946bb None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:05.111431 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c77e7-e9b5-454f-8e80-e3dca1c946bb None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a/groups/a10648da4c5a4c489567a2c0da5063ef/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:05.114561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c77e7-e9b5-454f-8e80-e3dca1c946bb None admin] RBAC: Authorizing `identity:create_grant(project_id=ebb4d7000b48410e8173e1b4a878579a, group_id=a10648da4c5a4c489567a2c0da5063ef, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:05.116034 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c77e7-e9b5-454f-8e80-e3dca1c946bb None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:05.250150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 194/389] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Aug 22 15:37:04 2022] PUT /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a/groups/a10648da4c5a4c489567a2c0da5063ef/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:37:05.390333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206fe9f-54c7-48d9-a744-02d7ddfffc23 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:05.560826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206fe9f-54c7-48d9-a744-02d7ddfffc23 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:05.606153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc051-9a85-4c6a-bad7-96ff0d93b450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:05.607469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc051-9a85-4c6a-bad7-96ff0d93b450 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:05.607879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc051-9a85-4c6a-bad7-96ff0d93b450 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:05.608331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc051-9a85-4c6a-bad7-96ff0d93b450 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:05.626910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dc051-9a85-4c6a-bad7-96ff0d93b450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-0d8dc051-9a85-4c6a-bad7-96ff0d93b450 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:05.632280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:05.633500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:05.634947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 196/390] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:37:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:05.641389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c77e7-e9b5-454f-8e80-e3dca1c946bb None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:05.672196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:05.806260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c77e7-e9b5-454f-8e80-e3dca1c946bb None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:05.863060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94b9cb-1a87-4d38-98b7-6bc10c6e0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:05.863600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94b9cb-1a87-4d38-98b7-6bc10c6e0896 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:05.863880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94b9cb-1a87-4d38-98b7-6bc10c6e0896 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:05.864269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94b9cb-1a87-4d38-98b7-6bc10c6e0896 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:05.865492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94b9cb-1a87-4d38-98b7-6bc10c6e0896 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:05.866115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94b9cb-1a87-4d38-98b7-6bc10c6e0896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:05.868837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94b9cb-1a87-4d38-98b7-6bc10c6e0896 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:05.882990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 195/391] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:05.889713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc051-9a85-4c6a-bad7-96ff0d93b450 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:05.933546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:06.038855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dc051-9a85-4c6a-bad7-96ff0d93b450 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:06.101007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13291932-f5ff-4e62-aae6-0b95d36f9677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:06.102151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291932-f5ff-4e62-aae6-0b95d36f9677 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:06.102632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291932-f5ff-4e62-aae6-0b95d36f9677 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:06.103174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13291932-f5ff-4e62-aae6-0b95d36f9677 None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:06.105420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13291932-f5ff-4e62-aae6-0b95d36f9677 None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:06.107973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13291932-f5ff-4e62-aae6-0b95d36f9677 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:06.114920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 197/392] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:05 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:06.119603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94b9cb-1a87-4d38-98b7-6bc10c6e0896 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:06.122846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9325a5-b769-4347-b5c5-46d8c64e0d8c None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:06.123271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9325a5-b769-4347-b5c5-46d8c64e0d8c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:06.123697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9325a5-b769-4347-b5c5-46d8c64e0d8c None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:06.126432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 198/393] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:06.134466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ae23-8db1-4b7d-9658-09ea7a5e4233 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:06.135487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ae23-8db1-4b7d-9658-09ea7a5e4233 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:06.135961 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ae23-8db1-4b7d-9658-09ea7a5e4233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:06.175696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-6493ae23-8db1-4b7d-9658-09ea7a5e4233 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:06.177329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6493ae23-8db1-4b7d-9658-09ea7a5e4233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:06.340128 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:06.344548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 199/394] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:06.407287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94b9cb-1a87-4d38-98b7-6bc10c6e0896 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:06.483064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447f4c6-b294-4ed8-9a0c-9989b29b0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:06.484064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447f4c6-b294-4ed8-9a0c-9989b29b0785 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:06.484501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447f4c6-b294-4ed8-9a0c-9989b29b0785 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:06.484968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447f4c6-b294-4ed8-9a0c-9989b29b0785 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:06.486301 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447f4c6-b294-4ed8-9a0c-9989b29b0785 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:06.487795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447f4c6-b294-4ed8-9a0c-9989b29b0785 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:06.489595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 196/395] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:06 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:06.496946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493ae23-8db1-4b7d-9658-09ea7a5e4233 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:06.569120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:06.664424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493ae23-8db1-4b7d-9658-09ea7a5e4233 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:06.722252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee8e0-c51a-401a-a05f-cbeaf210011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:06.722937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee8e0-c51a-401a-a05f-cbeaf210011e None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:06.723395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee8e0-c51a-401a-a05f-cbeaf210011e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:06.723808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efee8e0-c51a-401a-a05f-cbeaf210011e None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a/groups/a10648da4c5a4c489567a2c0da5063ef/roles/e5562064df7e4f1a96a35d581b4f28c4` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:06.731254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efee8e0-c51a-401a-a05f-cbeaf210011e None admin] RBAC: Authorizing `identity:create_grant(project_id=ebb4d7000b48410e8173e1b4a878579a, group_id=a10648da4c5a4c489567a2c0da5063ef, role_id=e5562064df7e4f1a96a35d581b4f28c4)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:06.732933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efee8e0-c51a-401a-a05f-cbeaf210011e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:06.766625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447f4c6-b294-4ed8-9a0c-9989b29b0785 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:06.812654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 200/396] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Aug 22 15:37:06 2022] PUT /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a/groups/a10648da4c5a4c489567a2c0da5063ef/roles/e5562064df7e4f1a96a35d581b4f28c4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:37:06.955328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447f4c6-b294-4ed8-9a0c-9989b29b0785 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:07.009082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acc7a9-86c7-4865-ba30-0daff1aa4b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:07.009834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc7a9-86c7-4865-ba30-0daff1aa4b27 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:07.010341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc7a9-86c7-4865-ba30-0daff1aa4b27 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:07.010774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc7a9-86c7-4865-ba30-0daff1aa4b27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:07.025057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acc7a9-86c7-4865-ba30-0daff1aa4b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-04acc7a9-86c7-4865-ba30-0daff1aa4b27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:07.031647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:07.033424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:07.034377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 197/397] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:07.040001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee8e0-c51a-401a-a05f-cbeaf210011e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:07.193726 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:07.195412 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2088c5-1603-4241-a43e-9e9a02a81480 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:07.195889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2088c5-1603-4241-a43e-9e9a02a81480 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:07.196400 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2088c5-1603-4241-a43e-9e9a02a81480 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:07.199043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 198/398] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:37:07.208416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2d133-e466-4209-add4-01e2645ced9c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:07.208804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2d133-e466-4209-add4-01e2645ced9c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:07.209223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2d133-e466-4209-add4-01e2645ced9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:07.214607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efee8e0-c51a-401a-a05f-cbeaf210011e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:07.241415 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:07.255763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-82b2d133-e466-4209-add4-01e2645ced9c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:07.258003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-82b2d133-e466-4209-add4-01e2645ced9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:07.314158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e26bc-0314-4a14-87e2-db89e8691669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:07.314845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e26bc-0314-4a14-87e2-db89e8691669 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:07.315126 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e26bc-0314-4a14-87e2-db89e8691669 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:07.315434 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e26bc-0314-4a14-87e2-db89e8691669 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:07.316212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e26bc-0314-4a14-87e2-db89e8691669 None admin] RBAC: Adding query filter params (name=member) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:07.316841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e26bc-0314-4a14-87e2-db89e8691669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:07.324032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e26bc-0314-4a14-87e2-db89e8691669 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:07.342472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 201/399] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:37:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:07.350463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e26bc-0314-4a14-87e2-db89e8691669 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:07.469018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 199/400] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:07.553639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e26bc-0314-4a14-87e2-db89e8691669 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:07.610286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ca6dd-cc7f-4358-bfac-99b617aedd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:07.611286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ca6dd-cc7f-4358-bfac-99b617aedd24 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:07.611747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ca6dd-cc7f-4358-bfac-99b617aedd24 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:07.612257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ca6dd-cc7f-4358-bfac-99b617aedd24 None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:07.613766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ca6dd-cc7f-4358-bfac-99b617aedd24 None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:07.615449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ca6dd-cc7f-4358-bfac-99b617aedd24 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:07.617324 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 202/401] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:07 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:07.625471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2d133-e466-4209-add4-01e2645ced9c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:07.708071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54697-1f45-4f36-aefd-1ef9a41ba74b None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:07.708480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54697-1f45-4f36-aefd-1ef9a41ba74b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:07.708928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54697-1f45-4f36-aefd-1ef9a41ba74b None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:07.711497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 203/402] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:37:07.718487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db62238-f728-4dac-97f7-a7f922904ada None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:07.718908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db62238-f728-4dac-97f7-a7f922904ada None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:07.719418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db62238-f728-4dac-97f7-a7f922904ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:07.769682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2d133-e466-4209-add4-01e2645ced9c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:07.778896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7db62238-f728-4dac-97f7-a7f922904ada None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:07.780821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7db62238-f728-4dac-97f7-a7f922904ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:07.819985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821296a5-ce7c-440a-85cf-67ce17b6f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:07.827889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821296a5-ce7c-440a-85cf-67ce17b6f295 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:07.828636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821296a5-ce7c-440a-85cf-67ce17b6f295 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:07.829230 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821296a5-ce7c-440a-85cf-67ce17b6f295 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:07.830865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821296a5-ce7c-440a-85cf-67ce17b6f295 None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:07.832732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821296a5-ce7c-440a-85cf-67ce17b6f295 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:07.832912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:07.835473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 200/403] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:07 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:07.854136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821296a5-ce7c-440a-85cf-67ce17b6f295 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:07.858402 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:07.967537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 204/404] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:07.969218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db62238-f728-4dac-97f7-a7f922904ada None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:08.023405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821296a5-ce7c-440a-85cf-67ce17b6f295 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:08.122775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f25361-6367-45a2-932b-cdfb64021c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:08.123481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f25361-6367-45a2-932b-cdfb64021c09 None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:08.123768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f25361-6367-45a2-932b-cdfb64021c09 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:08.124044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f25361-6367-45a2-932b-cdfb64021c09 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/groups/a10648da4c5a4c489567a2c0da5063ef/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:08.126168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f25361-6367-45a2-932b-cdfb64021c09 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d0eaf03e66c44178fdd9445fd20713b, group_id=a10648da4c5a4c489567a2c0da5063ef, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:08.127644 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f25361-6367-45a2-932b-cdfb64021c09 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:08.181173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db62238-f728-4dac-97f7-a7f922904ada None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:08.240129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f533f-2bce-49ad-b398-3a8db23233e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:08.241527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f533f-2bce-49ad-b398-3a8db23233e2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:08.242222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f533f-2bce-49ad-b398-3a8db23233e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:08.242869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f533f-2bce-49ad-b398-3a8db23233e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:08.264242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 201/405] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Aug 22 15:37:07 2022] PUT /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/groups/a10648da4c5a4c489567a2c0da5063ef/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:37:08.271461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f533f-2bce-49ad-b398-3a8db23233e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-f85f533f-2bce-49ad-b398-3a8db23233e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:08.280984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:08.282736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:08.284318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:08.289350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 205/406] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:37:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:08.299454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f25361-6367-45a2-932b-cdfb64021c09 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:08.405016 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:08.425652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f533f-2bce-49ad-b398-3a8db23233e2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:08.457515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:08.510897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f25361-6367-45a2-932b-cdfb64021c09 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:08.574288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a79e8-fe82-4b0b-954a-0d0bf2c4e61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:08.575200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a79e8-fe82-4b0b-954a-0d0bf2c4e61d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:08.575645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a79e8-fe82-4b0b-954a-0d0bf2c4e61d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:08.575975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a79e8-fe82-4b0b-954a-0d0bf2c4e61d None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:08.576706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a79e8-fe82-4b0b-954a-0d0bf2c4e61d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:08.577016 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a79e8-fe82-4b0b-954a-0d0bf2c4e61d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:08.578465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a79e8-fe82-4b0b-954a-0d0bf2c4e61d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:08.589090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 202/407] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:08.598870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a79e8-fe82-4b0b-954a-0d0bf2c4e61d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:08.629949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f533f-2bce-49ad-b398-3a8db23233e2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:08.694435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ab4d6-093f-4fbc-a28c-4b201b5f0e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:08.695816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ab4d6-093f-4fbc-a28c-4b201b5f0e35 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:08.696438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ab4d6-093f-4fbc-a28c-4b201b5f0e35 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:08.697094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ab4d6-093f-4fbc-a28c-4b201b5f0e35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:08.715908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ab4d6-093f-4fbc-a28c-4b201b5f0e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-523ab4d6-093f-4fbc-a28c-4b201b5f0e35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:08.726472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:08.728049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:08.732746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:08.735073 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 206/408] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:08.735520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a79e8-fe82-4b0b-954a-0d0bf2c4e61d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:08.743338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ab4d6-093f-4fbc-a28c-4b201b5f0e35 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:08.792139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:08.812580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde8127-2df7-4b94-ad5e-499e63e3c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:08.812580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde8127-2df7-4b94-ad5e-499e63e3c805 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:08.812580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde8127-2df7-4b94-ad5e-499e63e3c805 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:08.812580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde8127-2df7-4b94-ad5e-499e63e3c805 None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:08.812989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde8127-2df7-4b94-ad5e-499e63e3c805 None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:08.814901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde8127-2df7-4b94-ad5e-499e63e3c805 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:08.817696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 203/409] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:08 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:08.823634 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde8127-2df7-4b94-ad5e-499e63e3c805 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:08.911069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:08.972499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ab4d6-093f-4fbc-a28c-4b201b5f0e35 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:08.991426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde8127-2df7-4b94-ad5e-499e63e3c805 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:09.013603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd24d4-7460-4602-9908-84ba8e1a6550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:09.014296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd24d4-7460-4602-9908-84ba8e1a6550 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.014579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd24d4-7460-4602-9908-84ba8e1a6550 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.014896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd24d4-7460-4602-9908-84ba8e1a6550 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.015680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd24d4-7460-4602-9908-84ba8e1a6550 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:09.015861 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd24d4-7460-4602-9908-84ba8e1a6550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:09.017293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd24d4-7460-4602-9908-84ba8e1a6550 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:09.026850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 207/410] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:09.031749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fa0df-b747-407a-adfc-867cee1ec3fe None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.031749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fa0df-b747-407a-adfc-867cee1ec3fe None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.031749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fa0df-b747-407a-adfc-867cee1ec3fe None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.035005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 208/411] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:09.035996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fa0df-b747-407a-adfc-867cee1ec3fe None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:09.044991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca01bb-b10e-4549-8dd4-e94305a4216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:09.046059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca01bb-b10e-4549-8dd4-e94305a4216e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.046548 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca01bb-b10e-4549-8dd4-e94305a4216e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.047023 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca01bb-b10e-4549-8dd4-e94305a4216e None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.049776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca01bb-b10e-4549-8dd4-e94305a4216e None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:09.053324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca01bb-b10e-4549-8dd4-e94305a4216e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:09.055877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 204/412] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:08 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:09.062150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08d0a-20c9-4c54-b72d-52bb9376001a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.062150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08d0a-20c9-4c54-b72d-52bb9376001a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.062150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08d0a-20c9-4c54-b72d-52bb9376001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.087674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-1cd08d0a-20c9-4c54-b72d-52bb9376001a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:09.089635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1cd08d0a-20c9-4c54-b72d-52bb9376001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:09.174326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fa0df-b747-407a-adfc-867cee1ec3fe None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:09.185852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:09.201135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 205/413] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:09.202373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08d0a-20c9-4c54-b72d-52bb9376001a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:09.240152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:09.251492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929f9a-3e8a-464c-a7a2-a4f3041033cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:09.252461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929f9a-3e8a-464c-a7a2-a4f3041033cf None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.252988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929f9a-3e8a-464c-a7a2-a4f3041033cf None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.253428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929f9a-3e8a-464c-a7a2-a4f3041033cf None admin] PATH_INFO: `/v3/groups/b2768c77aae14bbfad07fb77f0f8a738` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.255418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b929f9a-3e8a-464c-a7a2-a4f3041033cf None admin] RBAC: Authorizing `identity:get_group(group_id=b2768c77aae14bbfad07fb77f0f8a738)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:09.262183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b929f9a-3e8a-464c-a7a2-a4f3041033cf None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:09.265370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 209/414] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:09 2022] GET /identity/v3/groups/b2768c77aae14bbfad07fb77f0f8a738 => generated 229 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:09.274320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929f9a-3e8a-464c-a7a2-a4f3041033cf None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:09.417705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08d0a-20c9-4c54-b72d-52bb9376001a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:09.475123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f0645-1db2-4682-984a-fc2dfa66488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:09.476170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f0645-1db2-4682-984a-fc2dfa66488e None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.476694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f0645-1db2-4682-984a-fc2dfa66488e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.477178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f0645-1db2-4682-984a-fc2dfa66488e None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/groups/a10648da4c5a4c489567a2c0da5063ef/roles/e5562064df7e4f1a96a35d581b4f28c4` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.480352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f0645-1db2-4682-984a-fc2dfa66488e None admin] RBAC: Authorizing `identity:create_grant(project_id=7d0eaf03e66c44178fdd9445fd20713b, group_id=a10648da4c5a4c489567a2c0da5063ef, role_id=e5562064df7e4f1a96a35d581b4f28c4)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:09.482157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f0645-1db2-4682-984a-fc2dfa66488e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:09.526457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929f9a-3e8a-464c-a7a2-a4f3041033cf None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:09.567334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e498cda-301f-4d11-87df-ef302f9d4477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:09.568178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e498cda-301f-4d11-87df-ef302f9d4477 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.568474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e498cda-301f-4d11-87df-ef302f9d4477 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.568789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e498cda-301f-4d11-87df-ef302f9d4477 None admin] PATH_INFO: `/v3/projects/01b431c789654fc6addb5ceef4aa5682` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.570034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e498cda-301f-4d11-87df-ef302f9d4477 None admin] RBAC: Authorizing `identity:get_project(project_id=01b431c789654fc6addb5ceef4aa5682)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:09.571453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e498cda-301f-4d11-87df-ef302f9d4477 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:09.576646 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 210/415] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:09 2022] GET /identity/v3/projects/01b431c789654fc6addb5ceef4aa5682 => generated 344 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:09.579936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 206/416] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Aug 22 15:37:09 2022] PUT /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b/groups/a10648da4c5a4c489567a2c0da5063ef/roles/e5562064df7e4f1a96a35d581b4f28c4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:37:09.581556 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e498cda-301f-4d11-87df-ef302f9d4477 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:09.678435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f0645-1db2-4682-984a-fc2dfa66488e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:09.707201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:09.763276 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:09.776545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e498cda-301f-4d11-87df-ef302f9d4477 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:09.826173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5015ac2-a830-45c9-a262-f19090eba2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:09.826950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5015ac2-a830-45c9-a262-f19090eba2b6 None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.827253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5015ac2-a830-45c9-a262-f19090eba2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.827535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5015ac2-a830-45c9-a262-f19090eba2b6 None admin] PATH_INFO: `/v3/projects/01b431c789654fc6addb5ceef4aa5682/groups/b2768c77aae14bbfad07fb77f0f8a738/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.831008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5015ac2-a830-45c9-a262-f19090eba2b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=01b431c789654fc6addb5ceef4aa5682, group_id=b2768c77aae14bbfad07fb77f0f8a738, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:09.832564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5015ac2-a830-45c9-a262-f19090eba2b6 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:09.868775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f0645-1db2-4682-984a-fc2dfa66488e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:09.936549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 211/417] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Aug 22 15:37:09 2022] PUT /identity/v3/projects/01b431c789654fc6addb5ceef4aa5682/groups/b2768c77aae14bbfad07fb77f0f8a738/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:37:09.945372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed342-724b-4b97-af1b-e9256c6c1405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:09.946497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed342-724b-4b97-af1b-e9256c6c1405 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.946961 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed342-724b-4b97-af1b-e9256c6c1405 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.947953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed342-724b-4b97-af1b-e9256c6c1405 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.974538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed342-724b-4b97-af1b-e9256c6c1405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:09.976576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab7166-8c45-4f05-8453-01d376defd75 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.976873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab7166-8c45-4f05-8453-01d376defd75 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.977202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab7166-8c45-4f05-8453-01d376defd75 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.979161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 212/418] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-f22ed342-724b-4b97-af1b-e9256c6c1405 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:09.981929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:09.982901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:37:09.983716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:09.986651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 207/419] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:09.992406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce58e60-57ec-4022-b560-225a83a6f4b0 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:09.992406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce58e60-57ec-4022-b560-225a83a6f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:09.992406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce58e60-57ec-4022-b560-225a83a6f4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:09.993885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed342-724b-4b97-af1b-e9256c6c1405 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:10.034535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-9ce58e60-57ec-4022-b560-225a83a6f4b0 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:10.037105 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9ce58e60-57ec-4022-b560-225a83a6f4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:10.158105 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed342-724b-4b97-af1b-e9256c6c1405 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:10.175312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:10.202719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe1179-fd33-4624-ad7a-4061035ad674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:10.204060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe1179-fd33-4624-ad7a-4061035ad674 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:10.204854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe1179-fd33-4624-ad7a-4061035ad674 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:10.205290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe1179-fd33-4624-ad7a-4061035ad674 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:10.206307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe1179-fd33-4624-ad7a-4061035ad674 None admin] RBAC: Adding query filter params (name=member) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:10.206769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe1179-fd33-4624-ad7a-4061035ad674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:10.208547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe1179-fd33-4624-ad7a-4061035ad674 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:10.219236 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 208/420] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:37:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:10.225026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe1179-fd33-4624-ad7a-4061035ad674 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:10.230742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 213/421] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:10.339295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe1179-fd33-4624-ad7a-4061035ad674 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:10.379437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7583a-544e-47c0-a0c3-c48cc9a06b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:10.380610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7583a-544e-47c0-a0c3-c48cc9a06b0c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:10.381095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7583a-544e-47c0-a0c3-c48cc9a06b0c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:10.381573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7583a-544e-47c0-a0c3-c48cc9a06b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:10.527528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:10.584152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7583a-544e-47c0-a0c3-c48cc9a06b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:10.586993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7583a-544e-47c0-a0c3-c48cc9a06b0c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:10.779489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce58e60-57ec-4022-b560-225a83a6f4b0 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:10.826664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 209/422] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 15:37:10.837188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7583a-544e-47c0-a0c3-c48cc9a06b0c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:10.912931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:10.977381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce58e60-57ec-4022-b560-225a83a6f4b0 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:11.052713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a00a2-bc2e-49eb-8499-ad347e898fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:11.054487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a00a2-bc2e-49eb-8499-ad347e898fda None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:11.054984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a00a2-bc2e-49eb-8499-ad347e898fda None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:11.055464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a00a2-bc2e-49eb-8499-ad347e898fda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:11.078297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a00a2-bc2e-49eb-8499-ad347e898fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9a0a00a2-bc2e-49eb-8499-ad347e898fda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:11.090454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:11.091432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:11.092245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:11.096702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 214/423] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:37:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:11.103310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a00a2-bc2e-49eb-8499-ad347e898fda None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:11.126307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:11.265144 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7583a-544e-47c0-a0c3-c48cc9a06b0c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:11.315723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a00a2-bc2e-49eb-8499-ad347e898fda None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:11.341542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8604e5e-89c7-4567-8a54-7abffa3e73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:11.342476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604e5e-89c7-4567-8a54-7abffa3e73e9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:11.343499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604e5e-89c7-4567-8a54-7abffa3e73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:11.344072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8604e5e-89c7-4567-8a54-7abffa3e73e9 None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:11.345809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8604e5e-89c7-4567-8a54-7abffa3e73e9 None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:11.347702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8604e5e-89c7-4567-8a54-7abffa3e73e9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:11.348976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:11.356492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 210/424] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:10 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:11.360378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4b2b-3081-408e-87d2-859cd99e1855 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:11.365810 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4b2b-3081-408e-87d2-859cd99e1855 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:11.365810 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4b2b-3081-408e-87d2-859cd99e1855 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:11.365810 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 211/425] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:11.365810 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a4b2b-3081-408e-87d2-859cd99e1855 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:11.388993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126d063-2bd4-4285-afad-91f0d48b3ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:11.389955 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d063-2bd4-4285-afad-91f0d48b3ae7 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:11.390420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d063-2bd4-4285-afad-91f0d48b3ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:11.390890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d063-2bd4-4285-afad-91f0d48b3ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:11.392057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126d063-2bd4-4285-afad-91f0d48b3ae7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:11.392661 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126d063-2bd4-4285-afad-91f0d48b3ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:11.395383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126d063-2bd4-4285-afad-91f0d48b3ae7 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:11.417150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 215/426] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:11.419345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68223846-c749-4e42-ae21-d9419ef99512 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:11.421159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68223846-c749-4e42-ae21-d9419ef99512 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:11.423084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68223846-c749-4e42-ae21-d9419ef99512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:11.451136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-68223846-c749-4e42-ae21-d9419ef99512 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:11.452628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-68223846-c749-4e42-ae21-d9419ef99512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:11.531202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a4b2b-3081-408e-87d2-859cd99e1855 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:11.548282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 216/427] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:11.548282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68223846-c749-4e42-ae21-d9419ef99512 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:11.602731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e17b-54bd-47e9-b399-20712bfb9642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:11.603954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e17b-54bd-47e9-b399-20712bfb9642 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:11.604552 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e17b-54bd-47e9-b399-20712bfb9642 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:11.605130 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e17b-54bd-47e9-b399-20712bfb9642 None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:11.606744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e17b-54bd-47e9-b399-20712bfb9642 None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:11.608504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e17b-54bd-47e9-b399-20712bfb9642 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:11.618110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 212/428] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:11 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:11.626425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e17b-54bd-47e9-b399-20712bfb9642 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:11.644848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:11.666322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68223846-c749-4e42-ae21-d9419ef99512 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:11.678955 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:11.710288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bc9db-6ba6-4fe3-b0da-396441f87536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:11.711268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bc9db-6ba6-4fe3-b0da-396441f87536 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:11.711810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bc9db-6ba6-4fe3-b0da-396441f87536 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:11.712441 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bc9db-6ba6-4fe3-b0da-396441f87536 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:11.757621 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e17b-54bd-47e9-b399-20712bfb9642 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:11.799532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bc9db-6ba6-4fe3-b0da-396441f87536 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:11.802844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bc9db-6ba6-4fe3-b0da-396441f87536 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:11.805727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e472c-3314-4064-b626-2c1643d8d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:11.807468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e472c-3314-4064-b626-2c1643d8d47e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:11.807805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e472c-3314-4064-b626-2c1643d8d47e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:11.808165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e472c-3314-4064-b626-2c1643d8d47e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:11.809062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e472c-3314-4064-b626-2c1643d8d47e None admin] RBAC: Adding query filter params (group.id=a10648da4c5a4c489567a2c0da5063ef, role.id=23c81c3dc8f743289ecb566849eb8324, scope.project.id=ebb4d7000b48410e8173e1b4a878579a) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:11.810545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e472c-3314-4064-b626-2c1643d8d47e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:11.811551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e472c-3314-4064-b626-2c1643d8d47e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:11.824404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 213/429] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 15:37:11 2022] GET /identity/v3/role_assignments?group.id=a10648da4c5a4c489567a2c0da5063ef&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:11.943091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 217/430] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:11.944905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e472c-3314-4064-b626-2c1643d8d47e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:12.074881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:12.119351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e472c-3314-4064-b626-2c1643d8d47e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:12.127019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bc9db-6ba6-4fe3-b0da-396441f87536 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:12.145265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:12.175279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ae46c-8595-4dc2-8578-068e9592220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:12.176449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ae46c-8595-4dc2-8578-068e9592220a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:12.176830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ae46c-8595-4dc2-8578-068e9592220a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:12.177300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ae46c-8595-4dc2-8578-068e9592220a None admin] PATH_INFO: `/v3/projects/ebb4d7000b48410e8173e1b4a878579a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:12.181195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ae46c-8595-4dc2-8578-068e9592220a None admin] RBAC: Authorizing `identity:get_project(project_id=ebb4d7000b48410e8173e1b4a878579a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:12.183612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ae46c-8595-4dc2-8578-068e9592220a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:12.187852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 214/431] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:11 2022] GET /identity/v3/projects/ebb4d7000b48410e8173e1b4a878579a => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:12.194939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ae46c-8595-4dc2-8578-068e9592220a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:12.294184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bc9db-6ba6-4fe3-b0da-396441f87536 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:12.340000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b295f09-8029-4605-a4b5-27dcedba73e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:12.340000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b295f09-8029-4605-a4b5-27dcedba73e0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:12.340000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b295f09-8029-4605-a4b5-27dcedba73e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:12.340000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b295f09-8029-4605-a4b5-27dcedba73e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:12.351997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b295f09-8029-4605-a4b5-27dcedba73e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-5b295f09-8029-4605-a4b5-27dcedba73e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:12.357981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:12.359825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:12.361559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 218/432] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:12.370905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b295f09-8029-4605-a4b5-27dcedba73e0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:12.414589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ae46c-8595-4dc2-8578-068e9592220a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:12.475962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164ae69-b8ab-4cf6-8dc8-b2ad530f78c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:12.477026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ae69-b8ab-4cf6-8dc8-b2ad530f78c1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:12.477926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ae69-b8ab-4cf6-8dc8-b2ad530f78c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:12.478206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164ae69-b8ab-4cf6-8dc8-b2ad530f78c1 None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:12.480380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164ae69-b8ab-4cf6-8dc8-b2ad530f78c1 None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:12.483057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164ae69-b8ab-4cf6-8dc8-b2ad530f78c1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:12.484823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 215/433] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:12 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:12.492322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164ae69-b8ab-4cf6-8dc8-b2ad530f78c1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:12.510400 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:12.514826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:12.568354 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b295f09-8029-4605-a4b5-27dcedba73e0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:12.617425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5640db-43ae-41c7-8a66-ad876b61010c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:12.618120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5640db-43ae-41c7-8a66-ad876b61010c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:12.618427 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5640db-43ae-41c7-8a66-ad876b61010c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:12.618791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5640db-43ae-41c7-8a66-ad876b61010c None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:12.619537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5640db-43ae-41c7-8a66-ad876b61010c None admin] RBAC: Adding query filter params (name=member) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:12.619853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5640db-43ae-41c7-8a66-ad876b61010c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:12.621414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5640db-43ae-41c7-8a66-ad876b61010c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:12.634214 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 219/434] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:37:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:12.640491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5640db-43ae-41c7-8a66-ad876b61010c None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:12.654398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164ae69-b8ab-4cf6-8dc8-b2ad530f78c1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:12.700472 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b61ed-9ca5-4840-85ac-0f8ef1c5899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:12.701998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b61ed-9ca5-4840-85ac-0f8ef1c5899a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:12.702672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b61ed-9ca5-4840-85ac-0f8ef1c5899a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:12.703146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b61ed-9ca5-4840-85ac-0f8ef1c5899a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:12.704093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b61ed-9ca5-4840-85ac-0f8ef1c5899a None admin] RBAC: Adding query filter params (group.id=a10648da4c5a4c489567a2c0da5063ef, role.id=e5562064df7e4f1a96a35d581b4f28c4, scope.project.id=ebb4d7000b48410e8173e1b4a878579a) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:12.704632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b61ed-9ca5-4840-85ac-0f8ef1c5899a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:12.706419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b61ed-9ca5-4840-85ac-0f8ef1c5899a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:12.720664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 216/435] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 15:37:12 2022] GET /identity/v3/role_assignments?group.id=a10648da4c5a4c489567a2c0da5063ef&scope.project.id=ebb4d7000b48410e8173e1b4a878579a&role.id=e5562064df7e4f1a96a35d581b4f28c4 => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:12.736716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8181ff-3150-417a-8be5-9d58d0480dec None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:12.737376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8181ff-3150-417a-8be5-9d58d0480dec None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:12.737654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8181ff-3150-417a-8be5-9d58d0480dec None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:12.739388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 217/436] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:12.745889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06db0b-a638-4bb6-b7db-347a282c65e1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:12.746210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06db0b-a638-4bb6-b7db-347a282c65e1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:12.746456 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06db0b-a638-4bb6-b7db-347a282c65e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:12.770971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-cb06db0b-a638-4bb6-b7db-347a282c65e1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:12.772719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-cb06db0b-a638-4bb6-b7db-347a282c65e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:12.807467 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5640db-43ae-41c7-8a66-ad876b61010c None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:12.876289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:12.881824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69be93a-38c3-4767-8cdb-df6d6883b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:12.882470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69be93a-38c3-4767-8cdb-df6d6883b979 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:12.882749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69be93a-38c3-4767-8cdb-df6d6883b979 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:12.883054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69be93a-38c3-4767-8cdb-df6d6883b979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:12.900048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 218/437] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:12.983010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69be93a-38c3-4767-8cdb-df6d6883b979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:12.986122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69be93a-38c3-4767-8cdb-df6d6883b979 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:13.058989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ed0fe-45f7-47d7-bf7f-a4a3dd11aef2 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:13.059177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ed0fe-45f7-47d7-bf7f-a4a3dd11aef2 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:13.059458 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ed0fe-45f7-47d7-bf7f-a4a3dd11aef2 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:13.061761 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 219/438] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:37:13.067679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f0fcf-c7df-4fc4-8be6-215dbeb7c011 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:13.067944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f0fcf-c7df-4fc4-8be6-215dbeb7c011 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:13.068216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f0fcf-c7df-4fc4-8be6-215dbeb7c011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:13.076925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:13.096622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-bd9f0fcf-c7df-4fc4-8be6-215dbeb7c011 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:13.098673 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-bd9f0fcf-c7df-4fc4-8be6-215dbeb7c011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:13.129019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 220/439] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 15:37:13.135383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69be93a-38c3-4767-8cdb-df6d6883b979 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:13.176890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:13.203338 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 220/440] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:13.242435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f0fcf-c7df-4fc4-8be6-215dbeb7c011 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:13.272543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69be93a-38c3-4767-8cdb-df6d6883b979 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:13.328244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705986ef-e37b-44bb-ae08-74ea6c418874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:13.328864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705986ef-e37b-44bb-ae08-74ea6c418874 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:13.329145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705986ef-e37b-44bb-ae08-74ea6c418874 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:13.329421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705986ef-e37b-44bb-ae08-74ea6c418874 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:13.333287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705986ef-e37b-44bb-ae08-74ea6c418874 None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:13.334854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705986ef-e37b-44bb-ae08-74ea6c418874 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:13.339216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 221/441] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:13 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:13.344047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705986ef-e37b-44bb-ae08-74ea6c418874 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:13.410929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f0fcf-c7df-4fc4-8be6-215dbeb7c011 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:13.462727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2485178-ba8c-41b1-9998-228c246ee7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:13.463401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2485178-ba8c-41b1-9998-228c246ee7c0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:13.463681 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2485178-ba8c-41b1-9998-228c246ee7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:13.463947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2485178-ba8c-41b1-9998-228c246ee7c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:13.466144 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:13.472590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:13.476097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705986ef-e37b-44bb-ae08-74ea6c418874 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:13.477382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2485178-ba8c-41b1-9998-228c246ee7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-c2485178-ba8c-41b1-9998-228c246ee7c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:13.482763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:13.485848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:13.486898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 221/442] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:37:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:13.488398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2485178-ba8c-41b1-9998-228c246ee7c0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:13.517442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2be90-2204-4c5c-b340-16b5c0524a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:13.518138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2be90-2204-4c5c-b340-16b5c0524a4d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:13.518417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2be90-2204-4c5c-b340-16b5c0524a4d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:13.518688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2be90-2204-4c5c-b340-16b5c0524a4d None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:13.520205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2be90-2204-4c5c-b340-16b5c0524a4d None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:13.521907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2be90-2204-4c5c-b340-16b5c0524a4d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:13.523470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 222/443] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:13 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:13.524218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2be90-2204-4c5c-b340-16b5c0524a4d None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:13.601048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2485178-ba8c-41b1-9998-228c246ee7c0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:13.634612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2be90-2204-4c5c-b340-16b5c0524a4d None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:13.648997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d1f7-6170-43b4-99d0-6a64f6ca1887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:13.649670 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d1f7-6170-43b4-99d0-6a64f6ca1887 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:13.649945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d1f7-6170-43b4-99d0-6a64f6ca1887 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:13.650216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d1f7-6170-43b4-99d0-6a64f6ca1887 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:13.661939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729d1f7-6170-43b4-99d0-6a64f6ca1887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-2729d1f7-6170-43b4-99d0-6a64f6ca1887 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:13.667247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:13.668237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 222/444] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:13.669459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d1f7-6170-43b4-99d0-6a64f6ca1887 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:13.683432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92829112-5dc2-4a27-b4ea-0080a46244b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:13.684074 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92829112-5dc2-4a27-b4ea-0080a46244b2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:13.684352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92829112-5dc2-4a27-b4ea-0080a46244b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:13.684659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92829112-5dc2-4a27-b4ea-0080a46244b2 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:13.685325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92829112-5dc2-4a27-b4ea-0080a46244b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:13.685632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92829112-5dc2-4a27-b4ea-0080a46244b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:13.687005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92829112-5dc2-4a27-b4ea-0080a46244b2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:13.695506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 223/445] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:13.701958 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92829112-5dc2-4a27-b4ea-0080a46244b2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:13.727615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:13.730080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:13.775365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d1f7-6170-43b4-99d0-6a64f6ca1887 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:13.798543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92829112-5dc2-4a27-b4ea-0080a46244b2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:13.812397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce84247-bc7a-4d34-8613-fb79149820b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:13.813046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84247-bc7a-4d34-8613-fb79149820b6 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:13.813325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84247-bc7a-4d34-8613-fb79149820b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:13.813596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84247-bc7a-4d34-8613-fb79149820b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:13.814328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce84247-bc7a-4d34-8613-fb79149820b6 None admin] RBAC: Adding query filter params (group.id=a10648da4c5a4c489567a2c0da5063ef, role.id=23c81c3dc8f743289ecb566849eb8324, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:13.814639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce84247-bc7a-4d34-8613-fb79149820b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:13.816089 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce84247-bc7a-4d34-8613-fb79149820b6 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:13.822626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 223/446] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 15:37:13 2022] GET /identity/v3/role_assignments?group.id=a10648da4c5a4c489567a2c0da5063ef&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=23c81c3dc8f743289ecb566849eb8324 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:13.823450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce84247-bc7a-4d34-8613-fb79149820b6 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:13.836060 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408d315-350e-4155-aaf2-f4a773c7c1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:13.836871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408d315-350e-4155-aaf2-f4a773c7c1b4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:13.837048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408d315-350e-4155-aaf2-f4a773c7c1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:13.837454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408d315-350e-4155-aaf2-f4a773c7c1b4 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:13.838698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408d315-350e-4155-aaf2-f4a773c7c1b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:13.838996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408d315-350e-4155-aaf2-f4a773c7c1b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:13.840665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408d315-350e-4155-aaf2-f4a773c7c1b4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:13.852676 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 224/447] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:13.858743 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408d315-350e-4155-aaf2-f4a773c7c1b4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:13.951438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce84247-bc7a-4d34-8613-fb79149820b6 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:13.978537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:13.987069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:13.997106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7aa74-7af9-4210-8276-f7c9b10c5fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:14.013430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7aa74-7af9-4210-8276-f7c9b10c5fbd None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:14.013430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7aa74-7af9-4210-8276-f7c9b10c5fbd None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:14.013632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408d315-350e-4155-aaf2-f4a773c7c1b4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:14.013731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7aa74-7af9-4210-8276-f7c9b10c5fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:14.042779 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09625a4-9d54-4db2-98c1-2fa4a1991be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:14.044476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09625a4-9d54-4db2-98c1-2fa4a1991be3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:14.044476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09625a4-9d54-4db2-98c1-2fa4a1991be3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:14.044476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09625a4-9d54-4db2-98c1-2fa4a1991be3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:14.093383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7aa74-7af9-4210-8276-f7c9b10c5fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:14.095056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7aa74-7af9-4210-8276-f7c9b10c5fbd None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:14.128620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09625a4-9d54-4db2-98c1-2fa4a1991be3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:14.130056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09625a4-9d54-4db2-98c1-2fa4a1991be3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:14.235021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 224/448] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:14.241528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7aa74-7af9-4210-8276-f7c9b10c5fbd None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:14.243831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:14.254125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 225/449] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 15:37:14.261714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09625a4-9d54-4db2-98c1-2fa4a1991be3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:14.263834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:14.347197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7aa74-7af9-4210-8276-f7c9b10c5fbd None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:14.370296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09625a4-9d54-4db2-98c1-2fa4a1991be3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:14.383967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99224232-cad5-44ce-a9e0-365f172c03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:14.385127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99224232-cad5-44ce-a9e0-365f172c03c3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:14.385340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99224232-cad5-44ce-a9e0-365f172c03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:14.385605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99224232-cad5-44ce-a9e0-365f172c03c3 None admin] PATH_INFO: `/v3/projects/7d0eaf03e66c44178fdd9445fd20713b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:14.386778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99224232-cad5-44ce-a9e0-365f172c03c3 None admin] RBAC: Authorizing `identity:get_project(project_id=7d0eaf03e66c44178fdd9445fd20713b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:14.388211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99224232-cad5-44ce-a9e0-365f172c03c3 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:14.394454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 225/450] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:14 2022] GET /identity/v3/projects/7d0eaf03e66c44178fdd9445fd20713b => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:14.397085 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99224232-cad5-44ce-a9e0-365f172c03c3 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:14.421925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef8c36-0500-40ea-95ea-bf0daf8f22d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:14.422571 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef8c36-0500-40ea-95ea-bf0daf8f22d2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:14.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef8c36-0500-40ea-95ea-bf0daf8f22d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:14.423112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef8c36-0500-40ea-95ea-bf0daf8f22d2 None admin] PATH_INFO: `/v3/projects/01b431c789654fc6addb5ceef4aa5682` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:14.424493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef8c36-0500-40ea-95ea-bf0daf8f22d2 None admin] RBAC: Authorizing `identity:get_project(project_id=01b431c789654fc6addb5ceef4aa5682)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:14.425971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef8c36-0500-40ea-95ea-bf0daf8f22d2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:14.427789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 226/451] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:37:14 2022] GET /identity/v3/projects/01b431c789654fc6addb5ceef4aa5682 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:14.433117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef8c36-0500-40ea-95ea-bf0daf8f22d2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:14.493523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:14.498545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:14.508189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99224232-cad5-44ce-a9e0-365f172c03c3 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:14.541000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef8c36-0500-40ea-95ea-bf0daf8f22d2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:14.544566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2a006-e23e-4d91-98bf-61bc406cfafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:14.545312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2a006-e23e-4d91-98bf-61bc406cfafe None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:14.545588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2a006-e23e-4d91-98bf-61bc406cfafe None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:14.545891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2a006-e23e-4d91-98bf-61bc406cfafe None admin] PATH_INFO: `/v3/groups/a10648da4c5a4c489567a2c0da5063ef` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:14.547049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2a006-e23e-4d91-98bf-61bc406cfafe None admin] RBAC: Authorizing `identity:get_group(group_id=a10648da4c5a4c489567a2c0da5063ef)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:14.548483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2a006-e23e-4d91-98bf-61bc406cfafe None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:14.550502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 226/452] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:14 2022] GET /identity/v3/groups/a10648da4c5a4c489567a2c0da5063ef => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:14.556078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2a006-e23e-4d91-98bf-61bc406cfafe None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:14.575902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde38b5-5b0a-4c52-bae1-8ebbec629d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:14.576594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde38b5-5b0a-4c52-bae1-8ebbec629d2b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:14.576870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde38b5-5b0a-4c52-bae1-8ebbec629d2b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:14.577137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde38b5-5b0a-4c52-bae1-8ebbec629d2b None admin] PATH_INFO: `/v3/groups/b2768c77aae14bbfad07fb77f0f8a738` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:14.578408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde38b5-5b0a-4c52-bae1-8ebbec629d2b None admin] RBAC: Authorizing `identity:get_group(group_id=b2768c77aae14bbfad07fb77f0f8a738)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:14.579997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde38b5-5b0a-4c52-bae1-8ebbec629d2b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:14.581591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 227/453] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 15:37:14 2022] GET /identity/v3/groups/b2768c77aae14bbfad07fb77f0f8a738 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:14.587391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde38b5-5b0a-4c52-bae1-8ebbec629d2b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:14.664845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2a006-e23e-4d91-98bf-61bc406cfafe None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:14.693858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde38b5-5b0a-4c52-bae1-8ebbec629d2b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:14.700243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817ec88-a424-4f26-a796-ca283bda1125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:14.700884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ec88-a424-4f26-a796-ca283bda1125 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:14.701166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ec88-a424-4f26-a796-ca283bda1125 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:14.701445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ec88-a424-4f26-a796-ca283bda1125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:14.702171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817ec88-a424-4f26-a796-ca283bda1125 None admin] RBAC: Adding query filter params (group.id=a10648da4c5a4c489567a2c0da5063ef, role.id=e5562064df7e4f1a96a35d581b4f28c4, scope.project.id=7d0eaf03e66c44178fdd9445fd20713b) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:14.702481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817ec88-a424-4f26-a796-ca283bda1125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:14.703922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817ec88-a424-4f26-a796-ca283bda1125 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:14.710099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 227/454] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 15:37:14 2022] GET /identity/v3/role_assignments?group.id=a10648da4c5a4c489567a2c0da5063ef&scope.project.id=7d0eaf03e66c44178fdd9445fd20713b&role.id=e5562064df7e4f1a96a35d581b4f28c4 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:14.723841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:14.735526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76bac2-4d90-4fc0-ab79-24871a594dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:14.736188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76bac2-4d90-4fc0-ab79-24871a594dcf None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:14.736466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76bac2-4d90-4fc0-ab79-24871a594dcf None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:14.736798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76bac2-4d90-4fc0-ab79-24871a594dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:14.737579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76bac2-4d90-4fc0-ab79-24871a594dcf None admin] RBAC: Adding query filter params (group.id=b2768c77aae14bbfad07fb77f0f8a738, role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=01b431c789654fc6addb5ceef4aa5682) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:14.737912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76bac2-4d90-4fc0-ab79-24871a594dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:14.739598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76bac2-4d90-4fc0-ab79-24871a594dcf None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:14.747338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 228/455] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 15:37:14 2022] GET /identity/v3/role_assignments?group.id=b2768c77aae14bbfad07fb77f0f8a738&scope.project.id=01b431c789654fc6addb5ceef4aa5682&role.id=eeb6551eeb934053866fc821b511b5dd => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:17.598253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3a6e-c5e2-4faa-b690-18151f3a828c None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:17.599078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3a6e-c5e2-4faa-b690-18151f3a828c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:17.599078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd3a6e-c5e2-4faa-b690-18151f3a828c None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:17.600486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 228/456] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:17.608133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21837d7b-06ba-4319-b89c-7b98992b3520 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:17.609554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21837d7b-06ba-4319-b89c-7b98992b3520 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:17.610331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21837d7b-06ba-4319-b89c-7b98992b3520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:17.653073 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-21837d7b-06ba-4319-b89c-7b98992b3520 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:17.655523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-21837d7b-06ba-4319-b89c-7b98992b3520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:17.801975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 229/457] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:18.152674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd3a6e-c5e2-4faa-b690-18151f3a828c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:18.180270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:18.294761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64729-b126-452a-8ea9-875eac7df698 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:18.295521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64729-b126-452a-8ea9-875eac7df698 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:18.296089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e64729-b126-452a-8ea9-875eac7df698 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:18.298442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 230/458] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:18.300036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91efc6c-b884-4e56-84ed-b146d0311edb None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:18.310920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91efc6c-b884-4e56-84ed-b146d0311edb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:18.310920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91efc6c-b884-4e56-84ed-b146d0311edb None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:18.311172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd3a6e-c5e2-4faa-b690-18151f3a828c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:18.311272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 231/459] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:18.311272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb0d28-1252-431a-ad81-09b11eed1584 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:18.311272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb0d28-1252-431a-ad81-09b11eed1584 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:18.311272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb0d28-1252-431a-ad81-09b11eed1584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:18.329517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ebbb0d28-1252-431a-ad81-09b11eed1584 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:18.331127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ebbb0d28-1252-431a-ad81-09b11eed1584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:18.348445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d04af-dc0b-4da5-bac4-2e16d08f5598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:18.355727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d04af-dc0b-4da5-bac4-2e16d08f5598 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:18.355727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d04af-dc0b-4da5-bac4-2e16d08f5598 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:18.355727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d04af-dc0b-4da5-bac4-2e16d08f5598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:18.361540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d04af-dc0b-4da5-bac4-2e16d08f5598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:18.363168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d04af-dc0b-4da5-bac4-2e16d08f5598 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-870d04af-dc0b-4da5-bac4-2e16d08f5598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:18.380389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:18.381409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:18.382265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:18.382265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:18.382265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:18.382265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 229/460] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:18.383837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368726e5-8c53-4d30-9531-199b3ada53a1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:18.385201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368726e5-8c53-4d30-9531-199b3ada53a1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:18.385201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368726e5-8c53-4d30-9531-199b3ada53a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:18.404790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-368726e5-8c53-4d30-9531-199b3ada53a1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:18.406187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-368726e5-8c53-4d30-9531-199b3ada53a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:18.418442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 232/461] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:18.419593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb0d28-1252-431a-ad81-09b11eed1584 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:18.482062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:18.494680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:18.514256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 230/462] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:18.514256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb19032-ca10-40ae-9f6d-45e605451415 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:18.514256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb19032-ca10-40ae-9f6d-45e605451415 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:18.514256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb19032-ca10-40ae-9f6d-45e605451415 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:18.518077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 231/463] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:18.519361 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1689-7977-483c-b9ba-e2952aa55b8a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:18.519647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1689-7977-483c-b9ba-e2952aa55b8a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:18.519924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1689-7977-483c-b9ba-e2952aa55b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:18.541611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e1aa1689-7977-483c-b9ba-e2952aa55b8a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:18.543186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e1aa1689-7977-483c-b9ba-e2952aa55b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:18.586764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb0d28-1252-431a-ad81-09b11eed1584 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:18.631981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 232/464] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:18.663644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aa6e9-09f5-4792-808f-b3745fa1c252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:18.665018 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aa6e9-09f5-4792-808f-b3745fa1c252 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:18.665511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aa6e9-09f5-4792-808f-b3745fa1c252 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:18.666005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019aa6e9-09f5-4792-808f-b3745fa1c252 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:18.666856 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aa6e9-09f5-4792-808f-b3745fa1c252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:18.667351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aa6e9-09f5-4792-808f-b3745fa1c252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:18.669244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019aa6e9-09f5-4792-808f-b3745fa1c252 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:18.700964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 233/465] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:18.708344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa1689-7977-483c-b9ba-e2952aa55b8a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:18.722849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aa6e9-09f5-4792-808f-b3745fa1c252 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:18.850864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019aa6e9-09f5-4792-808f-b3745fa1c252 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:18.867834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:18.890269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ecd0-93ca-470f-9aab-2f7c621559a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:18.890909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ecd0-93ca-470f-9aab-2f7c621559a4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:18.891188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ecd0-93ca-470f-9aab-2f7c621559a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:18.891455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ecd0-93ca-470f-9aab-2f7c621559a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:18.903626 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93ecd0-93ca-470f-9aab-2f7c621559a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:18.905358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93ecd0-93ca-470f-9aab-2f7c621559a4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-6c93ecd0-93ca-470f-9aab-2f7c621559a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:18.929497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:18.930506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:18.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:18.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:18.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:18.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 234/466] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:18.932863 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ecd0-93ca-470f-9aab-2f7c621559a4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:18.948688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa1689-7977-483c-b9ba-e2952aa55b8a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:18.987167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:18.993624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ccd5c-0ae6-4e34-a767-86889ddbe3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:18.994825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ccd5c-0ae6-4e34-a767-86889ddbe3d7 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:18.995101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ccd5c-0ae6-4e34-a767-86889ddbe3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:18.995367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ccd5c-0ae6-4e34-a767-86889ddbe3d7 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:18.996121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ccd5c-0ae6-4e34-a767-86889ddbe3d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:18.997720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ccd5c-0ae6-4e34-a767-86889ddbe3d7 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:19.058563 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ecd0-93ca-470f-9aab-2f7c621559a4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:19.094955 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703a315-3c3f-4931-b78d-4ec0832451d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:19.095721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703a315-3c3f-4931-b78d-4ec0832451d0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:19.096055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703a315-3c3f-4931-b78d-4ec0832451d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:19.096330 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703a315-3c3f-4931-b78d-4ec0832451d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:19.108559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703a315-3c3f-4931-b78d-4ec0832451d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:19.110263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703a315-3c3f-4931-b78d-4ec0832451d0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:19.128572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 233/467] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:37:18 2022] POST /identity/v3/users => generated 248 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:37:19.128572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ccd5c-0ae6-4e34-a767-86889ddbe3d7 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-0703a315-3c3f-4931-b78d-4ec0832451d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:19.132557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:19.133948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:19.135187 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:19.135187 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:19.135187 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:19.135187 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 235/468] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:19.135187 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703a315-3c3f-4931-b78d-4ec0832451d0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:19.166732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:19.269215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ccd5c-0ae6-4e34-a767-86889ddbe3d7 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:19.278490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703a315-3c3f-4931-b78d-4ec0832451d0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:19.312911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e280e-b481-4781-98cf-03fb791f68b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:19.313914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e280e-b481-4781-98cf-03fb791f68b3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:19.314407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e280e-b481-4781-98cf-03fb791f68b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:19.315886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e280e-b481-4781-98cf-03fb791f68b3 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:19.316004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e280e-b481-4781-98cf-03fb791f68b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:19.316664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e280e-b481-4781-98cf-03fb791f68b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:19.318984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e280e-b481-4781-98cf-03fb791f68b3 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:19.319499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3a82-efce-45c5-8268-c2ae177f25ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:19.320131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3a82-efce-45c5-8268-c2ae177f25ee None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:19.320404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3a82-efce-45c5-8268-c2ae177f25ee None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:19.320764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3a82-efce-45c5-8268-c2ae177f25ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:19.335718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 234/469] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:19.340537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e280e-b481-4781-98cf-03fb791f68b3 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:19.341388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee3a82-efce-45c5-8268-c2ae177f25ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:19.342880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee3a82-efce-45c5-8268-c2ae177f25ee None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-06ee3a82-efce-45c5-8268-c2ae177f25ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:19.361282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:19.362266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:19.363597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:19.363597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:19.363597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:19.363597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 236/470] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:19.364070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ff6f-13fa-4629-8748-e450ad75b513 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:19.364473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ff6f-13fa-4629-8748-e450ad75b513 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:19.364947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ff6f-13fa-4629-8748-e450ad75b513 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:19.367200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 237/471] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:19.368350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497ff6f-13fa-4629-8748-e450ad75b513 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:19.405570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:19.465301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:19.473248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e280e-b481-4781-98cf-03fb791f68b3 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:19.509268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497ff6f-13fa-4629-8748-e450ad75b513 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:19.511824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abb558-cbb5-4d0a-bf96-4b7157bd4d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:19.512317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abb558-cbb5-4d0a-bf96-4b7157bd4d08 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:19.512624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abb558-cbb5-4d0a-bf96-4b7157bd4d08 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:19.512890 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abb558-cbb5-4d0a-bf96-4b7157bd4d08 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:19.513551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abb558-cbb5-4d0a-bf96-4b7157bd4d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:19.513840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abb558-cbb5-4d0a-bf96-4b7157bd4d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:19.515222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abb558-cbb5-4d0a-bf96-4b7157bd4d08 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:19.532563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 235/472] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:19.532563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf9ae8-b891-48b3-83d8-68f2b174fb0b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:19.532563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf9ae8-b891-48b3-83d8-68f2b174fb0b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:19.532563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf9ae8-b891-48b3-83d8-68f2b174fb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:19.550402 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0bcf9ae8-b891-48b3-83d8-68f2b174fb0b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:19.551701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0bcf9ae8-b891-48b3-83d8-68f2b174fb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:19.553648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d538117-750e-4b86-afb2-907e3f8826c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:19.554264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d538117-750e-4b86-afb2-907e3f8826c0 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:19.554544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d538117-750e-4b86-afb2-907e3f8826c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:19.554814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d538117-750e-4b86-afb2-907e3f8826c0 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:19.555467 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d538117-750e-4b86-afb2-907e3f8826c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:19.557031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d538117-750e-4b86-afb2-907e3f8826c0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:19.624381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 236/473] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:19.625549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf9ae8-b891-48b3-83d8-68f2b174fb0b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:19.678673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 238/474] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:37:19 2022] POST /identity/v3/users => generated 246 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:37:19.679950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d538117-750e-4b86-afb2-907e3f8826c0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:19.683905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:19.821281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d538117-750e-4b86-afb2-907e3f8826c0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:19.846604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf9ae8-b891-48b3-83d8-68f2b174fb0b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:19.862250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:19.873813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eecfc-b9fb-4697-9047-6b3dccf94ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:19.878017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eecfc-b9fb-4697-9047-6b3dccf94ec2 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:19.878017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eecfc-b9fb-4697-9047-6b3dccf94ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:19.878017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eecfc-b9fb-4697-9047-6b3dccf94ec2 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:19.879020 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1eecfc-b9fb-4697-9047-6b3dccf94ec2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:19.881537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1eecfc-b9fb-4697-9047-6b3dccf94ec2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:19.925221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4d56a-e26b-4f15-8ca9-9bdaaf2e5a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:19.926135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4d56a-e26b-4f15-8ca9-9bdaaf2e5a9a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:19.926578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4d56a-e26b-4f15-8ca9-9bdaaf2e5a9a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:19.927064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4d56a-e26b-4f15-8ca9-9bdaaf2e5a9a None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:19.927689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4d56a-e26b-4f15-8ca9-9bdaaf2e5a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:19.927995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4d56a-e26b-4f15-8ca9-9bdaaf2e5a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:19.929478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4d56a-e26b-4f15-8ca9-9bdaaf2e5a9a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:19.942394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 237/475] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:19.943333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4d56a-e26b-4f15-8ca9-9bdaaf2e5a9a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:20.058389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 239/476] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:37:19 2022] POST /identity/v3/users => generated 249 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:37:20.059508 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eecfc-b9fb-4697-9047-6b3dccf94ec2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:20.088197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:20.100501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4d56a-e26b-4f15-8ca9-9bdaaf2e5a9a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:20.179291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965de448-e8f0-424e-8ea5-ec4c16b8e105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:20.179831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965de448-e8f0-424e-8ea5-ec4c16b8e105 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:20.180158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965de448-e8f0-424e-8ea5-ec4c16b8e105 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:20.180431 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965de448-e8f0-424e-8ea5-ec4c16b8e105 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:20.181137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965de448-e8f0-424e-8ea5-ec4c16b8e105 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:20.182621 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965de448-e8f0-424e-8ea5-ec4c16b8e105 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:20.240482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.sql.core [None req-965de448-e8f0-424e-8ea5-ec4c16b8e105 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 15:37:20.240482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 15:37:20.240482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [parameters: {'id': '260d7aab97834619aa41b046d8a63cc2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 15:37:20.240482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98421) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 15:37:20.254483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eecfc-b9fb-4697-9047-6b3dccf94ec2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-965de448-e8f0-424e-8ea5-ec4c16b8e105 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result.read() Aug 22 15:37:20.270202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return ref.to_dict() Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:37:20.271188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application yield resource Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise self.value Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application session.commit() Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 15:37:20.272113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.session.flush() Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application compat.raise_( Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 15:37:20.273227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:37:20.274132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result.read() Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:37:20.275113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [parameters: {'id': '260d7aab97834619aa41b046d8a63cc2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:20.275925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 15:37:20.280102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:20.282205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 238/477] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Aug 22 15:37:19 2022] POST /identity/v3/roles => generated 144 bytes in 329 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:20.282205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965de448-e8f0-424e-8ea5-ec4c16b8e105 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:20.298658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194e035-44a1-4281-b550-e1f9e1df7ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:20.299602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194e035-44a1-4281-b550-e1f9e1df7ffa None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:20.299879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194e035-44a1-4281-b550-e1f9e1df7ffa None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:20.300197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194e035-44a1-4281-b550-e1f9e1df7ffa None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:20.302328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194e035-44a1-4281-b550-e1f9e1df7ffa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:20.303959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194e035-44a1-4281-b550-e1f9e1df7ffa None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:20.419157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965de448-e8f0-424e-8ea5-ec4c16b8e105 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:20.467180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 240/478] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:37:20 2022] POST /identity/v3/users => generated 248 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:37:20.467408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602ab85-d7e0-415a-83d0-ad6514d4c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:20.467408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602ab85-d7e0-415a-83d0-ad6514d4c21e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:20.467408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602ab85-d7e0-415a-83d0-ad6514d4c21e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:20.467408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602ab85-d7e0-415a-83d0-ad6514d4c21e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:20.475527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602ab85-d7e0-415a-83d0-ad6514d4c21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-7602ab85-d7e0-415a-83d0-ad6514d4c21e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:20.480616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:20.481601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:37:20.482410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:20.485967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 239/479] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:37:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:20.488250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194e035-44a1-4281-b550-e1f9e1df7ffa None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:20.545309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:20.653069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194e035-44a1-4281-b550-e1f9e1df7ffa None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:20.698363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde071-97e6-4bd2-80d2-8bad0a477ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:20.699026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde071-97e6-4bd2-80d2-8bad0a477ae3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:20.699357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde071-97e6-4bd2-80d2-8bad0a477ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:20.699817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde071-97e6-4bd2-80d2-8bad0a477ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:20.700906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bde071-97e6-4bd2-80d2-8bad0a477ae3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:20.701450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bde071-97e6-4bd2-80d2-8bad0a477ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:20.703550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bde071-97e6-4bd2-80d2-8bad0a477ae3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:20.720016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 241/480] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:21.270767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c5258-4778-45eb-ac01-456626477168 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:21.271303 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c5258-4778-45eb-ac01-456626477168 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:21.271303 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c5258-4778-45eb-ac01-456626477168 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:21.273580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 240/481] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:21.279009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1b57-1ae0-4ebd-9d05-d31a48b16d79 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:21.279290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1b57-1ae0-4ebd-9d05-d31a48b16d79 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:21.279556 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1b57-1ae0-4ebd-9d05-d31a48b16d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:21.305570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-06dd1b57-1ae0-4ebd-9d05-d31a48b16d79 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:21.307363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-06dd1b57-1ae0-4ebd-9d05-d31a48b16d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:21.398092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 242/482] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:21.839785 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c5258-4778-45eb-ac01-456626477168 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:21.868457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:21.992939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c5258-4778-45eb-ac01-456626477168 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:22.074413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f448c-1cbd-462c-a239-87d0dd52ae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:22.075556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f448c-1cbd-462c-a239-87d0dd52ae63 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:22.076100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f448c-1cbd-462c-a239-87d0dd52ae63 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:22.076610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f448c-1cbd-462c-a239-87d0dd52ae63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:22.101730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f448c-1cbd-462c-a239-87d0dd52ae63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-3c1f448c-1cbd-462c-a239-87d0dd52ae63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:22.107435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:22.108401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:22.109251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:22.111919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 241/483] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:22.117580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1b57-1ae0-4ebd-9d05-d31a48b16d79 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:22.177692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:22.200109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a60e4-16ab-4237-8e0e-2b0836383cc0 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:22.200806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a60e4-16ab-4237-8e0e-2b0836383cc0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:22.201174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a60e4-16ab-4237-8e0e-2b0836383cc0 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:22.202825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 242/484] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:37:22.209926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebddb-a35f-44e3-a529-3431f9489f9d None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:22.210210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebddb-a35f-44e3-a529-3431f9489f9d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:22.210480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebddb-a35f-44e3-a529-3431f9489f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:22.254153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-eb9ebddb-a35f-44e3-a529-3431f9489f9d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:22.255660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-eb9ebddb-a35f-44e3-a529-3431f9489f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:22.333020 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1b57-1ae0-4ebd-9d05-d31a48b16d79 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:22.348303 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 243/485] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:22.415407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5a9cc-7efa-417d-8050-cc65469297a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:22.416380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5a9cc-7efa-417d-8050-cc65469297a0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:22.416909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5a9cc-7efa-417d-8050-cc65469297a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:22.417373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5a9cc-7efa-417d-8050-cc65469297a0 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:22.418597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5a9cc-7efa-417d-8050-cc65469297a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:22.419131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5a9cc-7efa-417d-8050-cc65469297a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:22.421683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5a9cc-7efa-417d-8050-cc65469297a0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:22.438109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 243/486] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:22.443725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ebddb-a35f-44e3-a529-3431f9489f9d None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:22.464670 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:22.576387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ebddb-a35f-44e3-a529-3431f9489f9d None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:22.612317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ad7f-99bb-45df-b02f-377657a9ddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:22.612997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ad7f-99bb-45df-b02f-377657a9ddac None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:22.613268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ad7f-99bb-45df-b02f-377657a9ddac None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:22.613605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ad7f-99bb-45df-b02f-377657a9ddac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:22.626465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8ad7f-99bb-45df-b02f-377657a9ddac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:22.627925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8ad7f-99bb-45df-b02f-377657a9ddac None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-b0f8ad7f-99bb-45df-b02f-377657a9ddac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:22.643688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:22.644684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:22.645591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:22.645591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:22.645591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:22.645591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 244/487] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:22.652942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5a9cc-7efa-417d-8050-cc65469297a0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:22.740308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ad7f-99bb-45df-b02f-377657a9ddac None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:22.866645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:22.872348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:22.886930 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5a9cc-7efa-417d-8050-cc65469297a0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:22.958749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ad7f-99bb-45df-b02f-377657a9ddac None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:22.968064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc08dc-9b99-4d42-9682-264ace3b3c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:22.968756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc08dc-9b99-4d42-9682-264ace3b3c1c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:22.969077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc08dc-9b99-4d42-9682-264ace3b3c1c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:22.969346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc08dc-9b99-4d42-9682-264ace3b3c1c None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:22.970011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc08dc-9b99-4d42-9682-264ace3b3c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:22.970317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc08dc-9b99-4d42-9682-264ace3b3c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:22.971750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc08dc-9b99-4d42-9682-264ace3b3c1c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:22.985485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 244/488] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:22.986920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3ae9-c698-457a-ad35-7af078a925e6 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:22.987217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3ae9-c698-457a-ad35-7af078a925e6 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:22.987468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3ae9-c698-457a-ad35-7af078a925e6 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:22.988896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 245/489] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:22.998664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf3ae9-c698-457a-ad35-7af078a925e6 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:23.018367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659dc9f-01c0-456d-9d42-3eb863a6b9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:23.019244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659dc9f-01c0-456d-9d42-3eb863a6b9f2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.019693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659dc9f-01c0-456d-9d42-3eb863a6b9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.020279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659dc9f-01c0-456d-9d42-3eb863a6b9f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.037126 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659dc9f-01c0-456d-9d42-3eb863a6b9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-0659dc9f-01c0-456d-9d42-3eb863a6b9f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:23.043308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:23.044546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:23.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:23.046703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 245/490] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:23.047937 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f01fa4-08b0-4a6e-b7b4-01f17933c053 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.048232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f01fa4-08b0-4a6e-b7b4-01f17933c053 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.048593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f01fa4-08b0-4a6e-b7b4-01f17933c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.078003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-76f01fa4-08b0-4a6e-b7b4-01f17933c053 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:23.079463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-76f01fa4-08b0-4a6e-b7b4-01f17933c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:23.146051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf3ae9-c698-457a-ad35-7af078a925e6 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:23.184397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 246/491] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:23.185949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f01fa4-08b0-4a6e-b7b4-01f17933c053 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:23.200734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e3d5d-e6ed-4743-86d0-81f0a302fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:23.201384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e3d5d-e6ed-4743-86d0-81f0a302fd5c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.201658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e3d5d-e6ed-4743-86d0-81f0a302fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.201926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e3d5d-e6ed-4743-86d0-81f0a302fd5c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.215622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e3d5d-e6ed-4743-86d0-81f0a302fd5c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:23.217239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e3d5d-e6ed-4743-86d0-81f0a302fd5c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-7b5e3d5d-e6ed-4743-86d0-81f0a302fd5c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:23.263855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:23.265490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:23.267046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:23.267046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:23.267046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:23.267046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:23.267046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:23.267046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:23.267046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:23.267046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:23.267046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:37:23.267046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:23.267903 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 246/492] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:23.278633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e3d5d-e6ed-4743-86d0-81f0a302fd5c None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:23.305965 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:23.321320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:23.404866 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f01fa4-08b0-4a6e-b7b4-01f17933c053 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:23.454721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3f93b-0aa9-4cdc-baed-6fb9ab2949f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:23.455635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3f93b-0aa9-4cdc-baed-6fb9ab2949f0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.455920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3f93b-0aa9-4cdc-baed-6fb9ab2949f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.456198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3f93b-0aa9-4cdc-baed-6fb9ab2949f0 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.458012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3f93b-0aa9-4cdc-baed-6fb9ab2949f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:23.458421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3f93b-0aa9-4cdc-baed-6fb9ab2949f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:23.460953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3f93b-0aa9-4cdc-baed-6fb9ab2949f0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:23.466592 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e3d5d-e6ed-4743-86d0-81f0a302fd5c None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:23.476094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 247/493] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:23.477715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f1ed-1510-469e-a245-dbef0ea1f1e6 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.478688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f1ed-1510-469e-a245-dbef0ea1f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.479227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8f1ed-1510-469e-a245-dbef0ea1f1e6 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.481794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 248/494] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:23.483024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08714-1434-4dd8-9599-bcf61b8c2f95 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.483354 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08714-1434-4dd8-9599-bcf61b8c2f95 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.483635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08714-1434-4dd8-9599-bcf61b8c2f95 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.485101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 249/495] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:23.485684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb08714-1434-4dd8-9599-bcf61b8c2f95 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:23.525557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88f55b-3c3d-402f-a96b-db12a66b56a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:23.526077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88f55b-3c3d-402f-a96b-db12a66b56a3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.526351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88f55b-3c3d-402f-a96b-db12a66b56a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.526614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88f55b-3c3d-402f-a96b-db12a66b56a3 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.527392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88f55b-3c3d-402f-a96b-db12a66b56a3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:23.527697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88f55b-3c3d-402f-a96b-db12a66b56a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:23.529172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88f55b-3c3d-402f-a96b-db12a66b56a3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:23.574013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 247/496] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 15:37:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:23.574013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ed98d-b326-44bf-a142-da60a7cf18cf None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.574013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ed98d-b326-44bf-a142-da60a7cf18cf None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.574013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ed98d-b326-44bf-a142-da60a7cf18cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.592596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-dc4ed98d-b326-44bf-a142-da60a7cf18cf None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:23.593916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-dc4ed98d-b326-44bf-a142-da60a7cf18cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:23.619459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb08714-1434-4dd8-9599-bcf61b8c2f95 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:23.636921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:23.661709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf751fd-4f18-4446-b129-f2b406f058af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:23.662358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf751fd-4f18-4446-b129-f2b406f058af None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.662631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf751fd-4f18-4446-b129-f2b406f058af None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.662898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf751fd-4f18-4446-b129-f2b406f058af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.667721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:23.673638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 248/497] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:23.675137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df0c2-2c61-4dc9-ba55-22fc78848a9a None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.675416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df0c2-2c61-4dc9-ba55-22fc78848a9a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.675683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df0c2-2c61-4dc9-ba55-22fc78848a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.677161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf751fd-4f18-4446-b129-f2b406f058af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:23.683635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf751fd-4f18-4446-b129-f2b406f058af None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-abf751fd-4f18-4446-b129-f2b406f058af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:23.698596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:23.699667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:23.701082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:23.701082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:23.701082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:23.701082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 250/498] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:23.701082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf751fd-4f18-4446-b129-f2b406f058af None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:23.707305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-937df0c2-2c61-4dc9-ba55-22fc78848a9a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:23.708623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-937df0c2-2c61-4dc9-ba55-22fc78848a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:23.806344 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 249/499] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:23.807674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937df0c2-2c61-4dc9-ba55-22fc78848a9a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:23.876712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf751fd-4f18-4446-b129-f2b406f058af None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:23.932058 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28161e02-92fe-44ea-a0cc-5c58546bbd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:23.933383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28161e02-92fe-44ea-a0cc-5c58546bbd79 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:23.934888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28161e02-92fe-44ea-a0cc-5c58546bbd79 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:23.935410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28161e02-92fe-44ea-a0cc-5c58546bbd79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:23.953917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28161e02-92fe-44ea-a0cc-5c58546bbd79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-28161e02-92fe-44ea-a0cc-5c58546bbd79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:23.961037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:23.961984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:23.962887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:23.966358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 251/500] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:23.967560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28161e02-92fe-44ea-a0cc-5c58546bbd79 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:24.002387 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937df0c2-2c61-4dc9-ba55-22fc78848a9a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:24.007653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:24.041256 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:24.052099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3bcaf-6f25-4956-bdcd-42e57d33514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:24.052703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3bcaf-6f25-4956-bdcd-42e57d33514d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:24.053003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3bcaf-6f25-4956-bdcd-42e57d33514d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:24.053266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3bcaf-6f25-4956-bdcd-42e57d33514d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:24.136675 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3bcaf-6f25-4956-bdcd-42e57d33514d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:24.138490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3bcaf-6f25-4956-bdcd-42e57d33514d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:24.142078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28161e02-92fe-44ea-a0cc-5c58546bbd79 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:24.191123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfdd2f-f641-41ff-8de2-a39149d84c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:24.191745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfdd2f-f641-41ff-8de2-a39149d84c69 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:24.192022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfdd2f-f641-41ff-8de2-a39149d84c69 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:24.192294 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfdd2f-f641-41ff-8de2-a39149d84c69 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:24.193004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfdd2f-f641-41ff-8de2-a39149d84c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:24.193310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfdd2f-f641-41ff-8de2-a39149d84c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:24.194783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfdd2f-f641-41ff-8de2-a39149d84c69 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:24.208968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 252/501] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:24.210803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfdd2f-f641-41ff-8de2-a39149d84c69 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:24.265038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 250/502] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:24.265950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3bcaf-6f25-4956-bdcd-42e57d33514d None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:24.302605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:24.331750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:24.356938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfdd2f-f641-41ff-8de2-a39149d84c69 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:24.388624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3bcaf-6f25-4956-bdcd-42e57d33514d None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:24.423510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7181be-6f14-48a5-97e7-92af7f4a3456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:24.424419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7181be-6f14-48a5-97e7-92af7f4a3456 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:24.424902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7181be-6f14-48a5-97e7-92af7f4a3456 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:24.425342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7181be-6f14-48a5-97e7-92af7f4a3456 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:24.426426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7181be-6f14-48a5-97e7-92af7f4a3456 None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:24.426929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7181be-6f14-48a5-97e7-92af7f4a3456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:24.429317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7181be-6f14-48a5-97e7-92af7f4a3456 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:24.442413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22a0b-611e-484a-817d-31d909d87273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:24.448283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 253/503] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:24.448562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22a0b-611e-484a-817d-31d909d87273 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:24.448562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22a0b-611e-484a-817d-31d909d87273 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:24.448745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7181be-6f14-48a5-97e7-92af7f4a3456 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:24.448832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22a0b-611e-484a-817d-31d909d87273 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:24.461031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22a0b-611e-484a-817d-31d909d87273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-06b22a0b-611e-484a-817d-31d909d87273 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:24.468873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:24.469880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:24.470721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 251/504] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:24.471993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22a0b-611e-484a-817d-31d909d87273 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:24.570504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7181be-6f14-48a5-97e7-92af7f4a3456 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:24.613834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78046b9a-936d-416c-bd92-e53ad2e60dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:24.614476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046b9a-936d-416c-bd92-e53ad2e60dc0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:24.614760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046b9a-936d-416c-bd92-e53ad2e60dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:24.615033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046b9a-936d-416c-bd92-e53ad2e60dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:24.618998 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:24.627570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78046b9a-936d-416c-bd92-e53ad2e60dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:24.629177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78046b9a-936d-416c-bd92-e53ad2e60dc0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:24.638864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:24.639850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22a0b-611e-484a-817d-31d909d87273 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-78046b9a-936d-416c-bd92-e53ad2e60dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:24.645528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:24.647322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:24.649036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:24.649036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:24.649036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:24.649036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 254/505] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:24.650590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78046b9a-936d-416c-bd92-e53ad2e60dc0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:24.702410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3475f-dd51-4658-a4b7-e729767c0128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:24.703556 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3475f-dd51-4658-a4b7-e729767c0128 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:24.704093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3475f-dd51-4658-a4b7-e729767c0128 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:24.704541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3475f-dd51-4658-a4b7-e729767c0128 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:24.716051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3475f-dd51-4658-a4b7-e729767c0128 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:24.718582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3475f-dd51-4658-a4b7-e729767c0128 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-83c3475f-dd51-4658-a4b7-e729767c0128 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:24.733428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:24.735369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 252/506] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 15:37:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:24.737257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3475f-dd51-4658-a4b7-e729767c0128 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:24.783072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78046b9a-936d-416c-bd92-e53ad2e60dc0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:24.829875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c2b24-831c-450b-b613-1522d857f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:24.830639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c2b24-831c-450b-b613-1522d857f185 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:24.830918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c2b24-831c-450b-b613-1522d857f185 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:24.831214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c2b24-831c-450b-b613-1522d857f185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:24.848221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c2b24-831c-450b-b613-1522d857f185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:24.850710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c2b24-831c-450b-b613-1522d857f185 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-837c2b24-831c-450b-b613-1522d857f185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:24.874543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:24.875969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:24.877518 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:24.877518 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:24.877518 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:24.877518 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 255/507] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:24.878275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c2b24-831c-450b-b613-1522d857f185 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:24.898457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3475f-dd51-4658-a4b7-e729767c0128 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:24.941142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e40e0-5fbe-45c4-8549-c1c111d6e154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:24.941780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e40e0-5fbe-45c4-8549-c1c111d6e154 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:24.942055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e40e0-5fbe-45c4-8549-c1c111d6e154 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:24.942328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e40e0-5fbe-45c4-8549-c1c111d6e154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:24.944492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:24.954934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e40e0-5fbe-45c4-8549-c1c111d6e154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:24.956409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e40e0-5fbe-45c4-8549-c1c111d6e154 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:24.966009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-7b7e40e0-5fbe-45c4-8549-c1c111d6e154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:24.972422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:24.973625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:24.974530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:24.974530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:24.974530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:24.974530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 253/508] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:24.974530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e40e0-5fbe-45c4-8549-c1c111d6e154 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:25.000263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c2b24-831c-450b-b613-1522d857f185 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:25.044527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e74c04-339f-4175-930b-766f781e6897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:25.045305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e74c04-339f-4175-930b-766f781e6897 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:25.045581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e74c04-339f-4175-930b-766f781e6897 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:25.045853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e74c04-339f-4175-930b-766f781e6897 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:25.046519 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e74c04-339f-4175-930b-766f781e6897 None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:25.046815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e74c04-339f-4175-930b-766f781e6897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:25.048182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e74c04-339f-4175-930b-766f781e6897 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:25.057456 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 256/509] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:25.058156 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e74c04-339f-4175-930b-766f781e6897 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:25.106836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e40e0-5fbe-45c4-8549-c1c111d6e154 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:25.143393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3867a20-be4e-4f10-b3fe-321695d1300b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:25.144100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867a20-be4e-4f10-b3fe-321695d1300b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:25.144389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867a20-be4e-4f10-b3fe-321695d1300b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:25.144697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867a20-be4e-4f10-b3fe-321695d1300b None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:25.145350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3867a20-be4e-4f10-b3fe-321695d1300b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:25.145651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3867a20-be4e-4f10-b3fe-321695d1300b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:25.147034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3867a20-be4e-4f10-b3fe-321695d1300b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:25.160266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 254/510] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:25.161082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3867a20-be4e-4f10-b3fe-321695d1300b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:25.170072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e74c04-339f-4175-930b-766f781e6897 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:25.188800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:25.211521 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894581c-6595-48e6-a8f5-4dc40d9c2f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:25.212246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894581c-6595-48e6-a8f5-4dc40d9c2f0d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:25.212560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894581c-6595-48e6-a8f5-4dc40d9c2f0d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:25.212838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894581c-6595-48e6-a8f5-4dc40d9c2f0d None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:25.213566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894581c-6595-48e6-a8f5-4dc40d9c2f0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:25.213875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894581c-6595-48e6-a8f5-4dc40d9c2f0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:25.215512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894581c-6595-48e6-a8f5-4dc40d9c2f0d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:25.225850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:25.256751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 257/511] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 15:37:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:25.258351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894581c-6595-48e6-a8f5-4dc40d9c2f0d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:25.270718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3867a20-be4e-4f10-b3fe-321695d1300b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:25.306791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524925-0a1b-457a-ae68-78b0f05bcb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:25.308223 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524925-0a1b-457a-ae68-78b0f05bcb47 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:25.308619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524925-0a1b-457a-ae68-78b0f05bcb47 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:25.308903 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524925-0a1b-457a-ae68-78b0f05bcb47 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:25.309561 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524925-0a1b-457a-ae68-78b0f05bcb47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:25.309868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524925-0a1b-457a-ae68-78b0f05bcb47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:25.311250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524925-0a1b-457a-ae68-78b0f05bcb47 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:25.322796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 255/512] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:25.323638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524925-0a1b-457a-ae68-78b0f05bcb47 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:25.389565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894581c-6595-48e6-a8f5-4dc40d9c2f0d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:25.438523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634211d-1f09-4e87-8ba3-04cbab77ec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:25.438523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634211d-1f09-4e87-8ba3-04cbab77ec6f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:25.438523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634211d-1f09-4e87-8ba3-04cbab77ec6f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:25.438523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634211d-1f09-4e87-8ba3-04cbab77ec6f None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:25.439385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634211d-1f09-4e87-8ba3-04cbab77ec6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:25.439385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634211d-1f09-4e87-8ba3-04cbab77ec6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:25.440303 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634211d-1f09-4e87-8ba3-04cbab77ec6f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:25.443178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524925-0a1b-457a-ae68-78b0f05bcb47 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:25.463950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 258/513] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:25.464843 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634211d-1f09-4e87-8ba3-04cbab77ec6f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:25.468320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:25.484816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11a72-29a3-4834-b76d-5ddbad742f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:25.485418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11a72-29a3-4834-b76d-5ddbad742f00 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:25.486995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11a72-29a3-4834-b76d-5ddbad742f00 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:25.486995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c11a72-29a3-4834-b76d-5ddbad742f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:25.497403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c11a72-29a3-4834-b76d-5ddbad742f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:25.498883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c11a72-29a3-4834-b76d-5ddbad742f00 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:25.505638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-c8c11a72-29a3-4834-b76d-5ddbad742f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:25.514622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:25.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:25.516493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:25.516493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:25.516493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:25.520686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 256/514] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:25.521763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11a72-29a3-4834-b76d-5ddbad742f00 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:25.581516 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634211d-1f09-4e87-8ba3-04cbab77ec6f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:25.618063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474beae5-1020-44f7-b99f-85c035b4d8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:25.618722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474beae5-1020-44f7-b99f-85c035b4d8f1 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:25.618997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474beae5-1020-44f7-b99f-85c035b4d8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:25.619240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474beae5-1020-44f7-b99f-85c035b4d8f1 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:25.619873 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474beae5-1020-44f7-b99f-85c035b4d8f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:25.621337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474beae5-1020-44f7-b99f-85c035b4d8f1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:25.631532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c11a72-29a3-4834-b76d-5ddbad742f00 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:25.668631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cf669-a7d1-47ca-ab6f-78af4eb6bf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:25.669243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cf669-a7d1-47ca-ab6f-78af4eb6bf27 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:25.669549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cf669-a7d1-47ca-ab6f-78af4eb6bf27 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:25.669822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cf669-a7d1-47ca-ab6f-78af4eb6bf27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:25.713833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:25.734090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 259/515] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:37:25 2022] POST /identity/v3/users => generated 247 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:37:25.740236 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474beae5-1020-44f7-b99f-85c035b4d8f1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:25.741174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cf669-a7d1-47ca-ab6f-78af4eb6bf27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:25.742808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cf669-a7d1-47ca-ab6f-78af4eb6bf27 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:25.852542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:25.868131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474beae5-1020-44f7-b99f-85c035b4d8f1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:25.888454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 257/516] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:25.888909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cf669-a7d1-47ca-ab6f-78af4eb6bf27 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:25.913911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07665a70-c75e-4d7f-a48c-426489113d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:25.914929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07665a70-c75e-4d7f-a48c-426489113d57 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:25.915406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07665a70-c75e-4d7f-a48c-426489113d57 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:25.915751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07665a70-c75e-4d7f-a48c-426489113d57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:25.927622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07665a70-c75e-4d7f-a48c-426489113d57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:25.930054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07665a70-c75e-4d7f-a48c-426489113d57 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-07665a70-c75e-4d7f-a48c-426489113d57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:25.948166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:25.949213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:25.950095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:25.950095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:25.950095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:25.950095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:25.950095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:25.950095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:25.950095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:25.950095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:25.950095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 260/517] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:25.952886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07665a70-c75e-4d7f-a48c-426489113d57 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:25.994060 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:26.035368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cf669-a7d1-47ca-ab6f-78af4eb6bf27 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:26.080606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d22e17-d48a-4b82-a843-630ba0c23ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:26.081423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d22e17-d48a-4b82-a843-630ba0c23ca3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:26.081813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d22e17-d48a-4b82-a843-630ba0c23ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:26.082013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d22e17-d48a-4b82-a843-630ba0c23ca3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:26.084121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07665a70-c75e-4d7f-a48c-426489113d57 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:26.092219 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d22e17-d48a-4b82-a843-630ba0c23ca3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:26.093846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d22e17-d48a-4b82-a843-630ba0c23ca3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-14d22e17-d48a-4b82-a843-630ba0c23ca3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:26.108080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:26.114279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 258/518] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:26.115435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d22e17-d48a-4b82-a843-630ba0c23ca3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:26.140379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff2588-69b4-4834-934d-a25dba281e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:26.141038 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff2588-69b4-4834-934d-a25dba281e63 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:26.141309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff2588-69b4-4834-934d-a25dba281e63 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:26.141671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff2588-69b4-4834-934d-a25dba281e63 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:26.142435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff2588-69b4-4834-934d-a25dba281e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:26.142753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff2588-69b4-4834-934d-a25dba281e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:26.144196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff2588-69b4-4834-934d-a25dba281e63 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:26.159690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 261/519] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:26.160603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff2588-69b4-4834-934d-a25dba281e63 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:26.182961 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:26.356671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d22e17-d48a-4b82-a843-630ba0c23ca3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:26.356671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:26.356671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94d3cc-4a44-46b7-92f7-410b48f795e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:26.356671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94d3cc-4a44-46b7-92f7-410b48f795e5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:26.357389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94d3cc-4a44-46b7-92f7-410b48f795e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:26.357389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94d3cc-4a44-46b7-92f7-410b48f795e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:26.357511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff2588-69b4-4834-934d-a25dba281e63 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94d3cc-4a44-46b7-92f7-410b48f795e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94d3cc-4a44-46b7-92f7-410b48f795e5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-be94d3cc-4a44-46b7-92f7-410b48f795e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:26.357591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:26.358217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 259/520] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:26.359514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94d3cc-4a44-46b7-92f7-410b48f795e5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:26.360679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993d07-3ec1-423e-8144-5203b8d23359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:26.360679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993d07-3ec1-423e-8144-5203b8d23359 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:26.360679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993d07-3ec1-423e-8144-5203b8d23359 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:26.360679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993d07-3ec1-423e-8144-5203b8d23359 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:26.361152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98993d07-3ec1-423e-8144-5203b8d23359 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:26.361152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98993d07-3ec1-423e-8144-5203b8d23359 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:26.361152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98993d07-3ec1-423e-8144-5203b8d23359 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:26.361152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 262/521] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:26.361152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993d07-3ec1-423e-8144-5203b8d23359 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:26.430668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:26.453040 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94d3cc-4a44-46b7-92f7-410b48f795e5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:26.468252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993d07-3ec1-423e-8144-5203b8d23359 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:26.489199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3463d9b-2bf6-4700-9441-ac192075109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:26.489820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3463d9b-2bf6-4700-9441-ac192075109a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:26.490098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3463d9b-2bf6-4700-9441-ac192075109a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:26.490372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3463d9b-2bf6-4700-9441-ac192075109a None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:26.491115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3463d9b-2bf6-4700-9441-ac192075109a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:26.491445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3463d9b-2bf6-4700-9441-ac192075109a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:26.493101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3463d9b-2bf6-4700-9441-ac192075109a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:26.505547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4d524-33cd-49c5-9d61-f702bf1c4744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:26.506188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4d524-33cd-49c5-9d61-f702bf1c4744 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:26.506466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4d524-33cd-49c5-9d61-f702bf1c4744 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:26.506734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4d524-33cd-49c5-9d61-f702bf1c4744 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:26.517387 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 260/522] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Aug 22 15:37:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:26.517387 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3463d9b-2bf6-4700-9441-ac192075109a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:26.517654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4d524-33cd-49c5-9d61-f702bf1c4744 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:26.518147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4d524-33cd-49c5-9d61-f702bf1c4744 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-83f4d524-33cd-49c5-9d61-f702bf1c4744 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:26.531335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:26.532409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 263/523] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:26.533956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4d524-33cd-49c5-9d61-f702bf1c4744 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:26.570761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:26.643201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3463d9b-2bf6-4700-9441-ac192075109a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:26.652148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4d524-33cd-49c5-9d61-f702bf1c4744 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:26.680694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe10754-3675-44de-8353-80ac910e4a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:26.681921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe10754-3675-44de-8353-80ac910e4a0b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:26.682194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe10754-3675-44de-8353-80ac910e4a0b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:26.682458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe10754-3675-44de-8353-80ac910e4a0b None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:26.682554 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:26.683109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe10754-3675-44de-8353-80ac910e4a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:26.683410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe10754-3675-44de-8353-80ac910e4a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:26.684778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe10754-3675-44de-8353-80ac910e4a0b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:26.691386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec27d6-e4fc-40e1-a73c-886ede5aedaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:26.692083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec27d6-e4fc-40e1-a73c-886ede5aedaf None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:26.692366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec27d6-e4fc-40e1-a73c-886ede5aedaf None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:26.692677 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec27d6-e4fc-40e1-a73c-886ede5aedaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:26.693406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec27d6-e4fc-40e1-a73c-886ede5aedaf None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=d8d073f3152f4825becf78c24539477e) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:26.693717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec27d6-e4fc-40e1-a73c-886ede5aedaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:26.695186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec27d6-e4fc-40e1-a73c-886ede5aedaf None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:26.697844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 261/524] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:26.698442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe10754-3675-44de-8353-80ac910e4a0b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:26.705800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 264/525] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:26 2022] GET /identity/v3/role_assignments?user.id=d8d073f3152f4825becf78c24539477e&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:26.706488 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec27d6-e4fc-40e1-a73c-886ede5aedaf None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:26.838736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec27d6-e4fc-40e1-a73c-886ede5aedaf None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:26.845343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe10754-3675-44de-8353-80ac910e4a0b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:26.849474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:26.877734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e3020-6c4e-4ca2-9cef-051c528d0d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:26.878799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e3020-6c4e-4ca2-9cef-051c528d0d24 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:26.879307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e3020-6c4e-4ca2-9cef-051c528d0d24 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:26.879803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e3020-6c4e-4ca2-9cef-051c528d0d24 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:26.880854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e3020-6c4e-4ca2-9cef-051c528d0d24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:26.881368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e3020-6c4e-4ca2-9cef-051c528d0d24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:26.883074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e3020-6c4e-4ca2-9cef-051c528d0d24 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:26.897260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10d206-cf04-418d-aaf2-5981a92538d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:26.897807 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10d206-cf04-418d-aaf2-5981a92538d0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:26.898088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10d206-cf04-418d-aaf2-5981a92538d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:26.898360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10d206-cf04-418d-aaf2-5981a92538d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:26.910172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 265/526] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 15:37:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:26.911468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e3020-6c4e-4ca2-9cef-051c528d0d24 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:26.995125 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:27.000400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10d206-cf04-418d-aaf2-5981a92538d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:27.002932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10d206-cf04-418d-aaf2-5981a92538d0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:27.067571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e3020-6c4e-4ca2-9cef-051c528d0d24 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:27.104920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c07a86-501e-4e59-bff8-5d5e038d461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:27.105853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c07a86-501e-4e59-bff8-5d5e038d461b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:27.106282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c07a86-501e-4e59-bff8-5d5e038d461b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:27.106762 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c07a86-501e-4e59-bff8-5d5e038d461b None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:27.115185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c07a86-501e-4e59-bff8-5d5e038d461b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:27.116953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c07a86-501e-4e59-bff8-5d5e038d461b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-11c07a86-501e-4e59-bff8-5d5e038d461b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:27.129582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:27.130665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:27.131747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:27.131747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:27.131747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:27.131747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:27.131747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:27.131747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:27.131747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:27.131747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:27.133478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 266/527] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:27.139259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c07a86-501e-4e59-bff8-5d5e038d461b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:27.140590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 262/528] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:27.141623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10d206-cf04-418d-aaf2-5981a92538d0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:27.144363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:27.254654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10d206-cf04-418d-aaf2-5981a92538d0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:27.266390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c07a86-501e-4e59-bff8-5d5e038d461b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:27.278399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:27.306591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49372edd-b6e2-4b0a-8da1-99dd54fddd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:27.307554 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49372edd-b6e2-4b0a-8da1-99dd54fddd23 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:27.308045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49372edd-b6e2-4b0a-8da1-99dd54fddd23 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:27.308533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49372edd-b6e2-4b0a-8da1-99dd54fddd23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:27.309043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bc7c4-e544-47ae-8a00-701e60200e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:27.309652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bc7c4-e544-47ae-8a00-701e60200e29 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:27.309932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bc7c4-e544-47ae-8a00-701e60200e29 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:27.310200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bc7c4-e544-47ae-8a00-701e60200e29 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:27.310898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bc7c4-e544-47ae-8a00-701e60200e29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:27.311204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bc7c4-e544-47ae-8a00-701e60200e29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:27.312924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bc7c4-e544-47ae-8a00-701e60200e29 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:27.337249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 263/529] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:27.338536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bc7c4-e544-47ae-8a00-701e60200e29 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:27.390672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49372edd-b6e2-4b0a-8da1-99dd54fddd23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:27.392762 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49372edd-b6e2-4b0a-8da1-99dd54fddd23 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:27.416864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:27.459666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bc7c4-e544-47ae-8a00-701e60200e29 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:27.498465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671796b-110d-4976-b196-9123c4e78728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:27.499266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671796b-110d-4976-b196-9123c4e78728 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:27.499647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671796b-110d-4976-b196-9123c4e78728 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:27.500033 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671796b-110d-4976-b196-9123c4e78728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:27.511913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671796b-110d-4976-b196-9123c4e78728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:27.513543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671796b-110d-4976-b196-9123c4e78728 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:27.517460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 267/530] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:27.518326 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49372edd-b6e2-4b0a-8da1-99dd54fddd23 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:27.531165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-a671796b-110d-4976-b196-9123c4e78728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:27.531806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:27.533706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:27.536122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:27.536122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:27.536122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:27.544538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 264/531] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:27.544538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671796b-110d-4976-b196-9123c4e78728 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:27.628430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49372edd-b6e2-4b0a-8da1-99dd54fddd23 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:27.662345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671796b-110d-4976-b196-9123c4e78728 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:27.669600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe626-bfd6-4d3a-8b89-00852333afff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:27.670280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe626-bfd6-4d3a-8b89-00852333afff None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:27.670561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe626-bfd6-4d3a-8b89-00852333afff None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:27.670839 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe626-bfd6-4d3a-8b89-00852333afff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:27.671650 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfe626-bfd6-4d3a-8b89-00852333afff None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=1c12495a6cf64c80b45785f185f28383) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:27.671962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfe626-bfd6-4d3a-8b89-00852333afff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:27.673639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfe626-bfd6-4d3a-8b89-00852333afff None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:27.681637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 268/532] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:27 2022] GET /identity/v3/role_assignments?user.id=1c12495a6cf64c80b45785f185f28383&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:27.682355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe626-bfd6-4d3a-8b89-00852333afff None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:27.684420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:27.741897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd98de-81aa-421a-ab51-e1448b5736a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:27.743139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd98de-81aa-421a-ab51-e1448b5736a3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:27.743493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd98de-81aa-421a-ab51-e1448b5736a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:27.743866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd98de-81aa-421a-ab51-e1448b5736a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:27.762782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd98de-81aa-421a-ab51-e1448b5736a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:27.764216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd98de-81aa-421a-ab51-e1448b5736a3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:27.786374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-0afd98de-81aa-421a-ab51-e1448b5736a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:27.794923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:27.795918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:27.796820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:27.796820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:27.796820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:27.800659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 265/533] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:27.803517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd98de-81aa-421a-ab51-e1448b5736a3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:27.819397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe626-bfd6-4d3a-8b89-00852333afff None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:27.860937 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5243e68-2e23-48a8-9a53-1c43da74e41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:27.861913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243e68-2e23-48a8-9a53-1c43da74e41e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:27.862384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243e68-2e23-48a8-9a53-1c43da74e41e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:27.862831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243e68-2e23-48a8-9a53-1c43da74e41e None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:27.863671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5243e68-2e23-48a8-9a53-1c43da74e41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:27.864159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5243e68-2e23-48a8-9a53-1c43da74e41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:27.865931 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5243e68-2e23-48a8-9a53-1c43da74e41e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:27.880586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 269/534] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:27.887648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5243e68-2e23-48a8-9a53-1c43da74e41e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:28.013449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5243e68-2e23-48a8-9a53-1c43da74e41e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:28.015183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd98de-81aa-421a-ab51-e1448b5736a3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:28.052893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f4edb-9d6f-4b8e-b56b-2a10a11d28e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:28.053575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4edb-9d6f-4b8e-b56b-2a10a11d28e4 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:28.053826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4edb-9d6f-4b8e-b56b-2a10a11d28e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:28.054100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f4edb-9d6f-4b8e-b56b-2a10a11d28e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:28.054854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caa069-166a-4686-b5e6-fccc08a55032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:28.055575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa069-166a-4686-b5e6-fccc08a55032 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:28.056480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa069-166a-4686-b5e6-fccc08a55032 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:28.056884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa069-166a-4686-b5e6-fccc08a55032 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:28.057666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caa069-166a-4686-b5e6-fccc08a55032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:28.058077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caa069-166a-4686-b5e6-fccc08a55032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:28.059928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caa069-166a-4686-b5e6-fccc08a55032 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:28.067899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f4edb-9d6f-4b8e-b56b-2a10a11d28e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:28.070166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f4edb-9d6f-4b8e-b56b-2a10a11d28e4 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:28.072353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:28.082135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 266/535] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:28.083729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c3671-a199-49f2-bb47-d1d3a92e1b45 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:28.084079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c3671-a199-49f2-bb47-d1d3a92e1b45 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:28.084419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c3671-a199-49f2-bb47-d1d3a92e1b45 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:28.086290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 267/536] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:28.087144 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c3671-a199-49f2-bb47-d1d3a92e1b45 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-804f4edb-9d6f-4b8e-b56b-2a10a11d28e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:28.096550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:28.097947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 270/537] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6f0da-54b8-48bc-92c7-322c4993c1df None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:28.099123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6f0da-54b8-48bc-92c7-322c4993c1df None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:28.099858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6f0da-54b8-48bc-92c7-322c4993c1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:28.125914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-9ce6f0da-54b8-48bc-92c7-322c4993c1df None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:28.128822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9ce6f0da-54b8-48bc-92c7-322c4993c1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:28.133977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:28.231792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 271/538] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:28.233212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6f0da-54b8-48bc-92c7-322c4993c1df None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:28.244885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c3671-a199-49f2-bb47-d1d3a92e1b45 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:28.358586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6f0da-54b8-48bc-92c7-322c4993c1df None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:28.361312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56c37a-d533-41d5-85e8-7a93f83ed58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:28.361979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56c37a-d533-41d5-85e8-7a93f83ed58a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:28.362251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56c37a-d533-41d5-85e8-7a93f83ed58a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:28.362514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56c37a-d533-41d5-85e8-7a93f83ed58a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:28.381783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56c37a-d533-41d5-85e8-7a93f83ed58a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:28.383836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56c37a-d533-41d5-85e8-7a93f83ed58a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:28.406366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015e207-bf10-4e44-ac59-a8f08670b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:28.407294 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015e207-bf10-4e44-ac59-a8f08670b449 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:28.407784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015e207-bf10-4e44-ac59-a8f08670b449 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:28.408380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015e207-bf10-4e44-ac59-a8f08670b449 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-7a56c37a-d533-41d5-85e8-7a93f83ed58a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:28.412116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:28.413239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:28.414111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:28.414111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:28.414111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:28.414111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:28.414111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:28.414111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:28.414111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:28.414111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:28.414580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:28.415452 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015e207-bf10-4e44-ac59-a8f08670b449 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:28.416134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015e207-bf10-4e44-ac59-a8f08670b449 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:28.418575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015e207-bf10-4e44-ac59-a8f08670b449 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:28.421746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 268/539] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:28.432171 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56c37a-d533-41d5-85e8-7a93f83ed58a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:28.435919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 272/540] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:28.452557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015e207-bf10-4e44-ac59-a8f08670b449 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:28.574056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015e207-bf10-4e44-ac59-a8f08670b449 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:28.611680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7c226-e793-4af7-b952-f20a33986800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:28.612658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7c226-e793-4af7-b952-f20a33986800 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:28.613110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7c226-e793-4af7-b952-f20a33986800 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:28.613556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7c226-e793-4af7-b952-f20a33986800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:28.614467 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7c226-e793-4af7-b952-f20a33986800 None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=90324fa56d0743699f2fddd17fb630dd) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:28.614985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7c226-e793-4af7-b952-f20a33986800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:28.616650 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7c226-e793-4af7-b952-f20a33986800 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:28.624322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 273/541] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:28 2022] GET /identity/v3/role_assignments?user.id=90324fa56d0743699f2fddd17fb630dd&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:28.657052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:28.676998 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56c37a-d533-41d5-85e8-7a93f83ed58a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:28.719671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d35f35-1763-4646-a34c-651371f6930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:28.720801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35f35-1763-4646-a34c-651371f6930f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:28.721440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35f35-1763-4646-a34c-651371f6930f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:28.722124 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35f35-1763-4646-a34c-651371f6930f None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:28.723190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d35f35-1763-4646-a34c-651371f6930f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:28.723871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d35f35-1763-4646-a34c-651371f6930f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:28.729925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d35f35-1763-4646-a34c-651371f6930f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:28.745092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7c226-e793-4af7-b952-f20a33986800 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:28.749273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 269/542] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:28.755085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d35f35-1763-4646-a34c-651371f6930f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:28.883380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d35f35-1763-4646-a34c-651371f6930f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:28.896932 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:28.929790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99656cf9-3525-4db8-9690-67f53593b229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:28.930687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656cf9-3525-4db8-9690-67f53593b229 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:28.931598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656cf9-3525-4db8-9690-67f53593b229 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:28.931878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99656cf9-3525-4db8-9690-67f53593b229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:28.932765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99656cf9-3525-4db8-9690-67f53593b229 None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=c2de83ba29194578a9a229d5bab6612e) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:28.933174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99656cf9-3525-4db8-9690-67f53593b229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:28.935178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99656cf9-3525-4db8-9690-67f53593b229 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:28.943044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 270/543] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:28 2022] GET /identity/v3/role_assignments?user.id=c2de83ba29194578a9a229d5bab6612e&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:29.007406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7c226-e793-4af7-b952-f20a33986800 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:29.067853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55138f-9585-4fd9-96b7-d862cf4932c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:29.068543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55138f-9585-4fd9-96b7-d862cf4932c4 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:29.068829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55138f-9585-4fd9-96b7-d862cf4932c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:29.069100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55138f-9585-4fd9-96b7-d862cf4932c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:29.084707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55138f-9585-4fd9-96b7-d862cf4932c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-2d55138f-9585-4fd9-96b7-d862cf4932c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:29.094991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:29.095985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:29.096856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 274/544] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:29.104721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99656cf9-3525-4db8-9690-67f53593b229 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:29.128961 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:29.244553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7325bf-49a1-47a2-81b3-bfcf4b50854d None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:29.245209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7325bf-49a1-47a2-81b3-bfcf4b50854d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:29.245687 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7325bf-49a1-47a2-81b3-bfcf4b50854d None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:29.248117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 275/545] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:29.258003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f485a7-e3a5-4a60-88d4-5d13ccb878d4 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:29.258653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f485a7-e3a5-4a60-88d4-5d13ccb878d4 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:29.259168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f485a7-e3a5-4a60-88d4-5d13ccb878d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:29.271271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99656cf9-3525-4db8-9690-67f53593b229 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:29.296781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c5f485a7-e3a5-4a60-88d4-5d13ccb878d4 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:29.298394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c5f485a7-e3a5-4a60-88d4-5d13ccb878d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:29.321695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bf876-f318-4ebd-b432-a3b6b944d1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:29.323820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bf876-f318-4ebd-b432-a3b6b944d1db None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:29.326332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bf876-f318-4ebd-b432-a3b6b944d1db None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:29.326865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bf876-f318-4ebd-b432-a3b6b944d1db None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:29.327799 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bf876-f318-4ebd-b432-a3b6b944d1db None admin] RBAC: Adding query filter params (name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:29.328832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bf876-f318-4ebd-b432-a3b6b944d1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:29.330686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bf876-f318-4ebd-b432-a3b6b944d1db None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:29.355506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 271/546] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:29.362413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bf876-f318-4ebd-b432-a3b6b944d1db None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:29.476267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 276/547] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:29.513084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:29.519584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bf876-f318-4ebd-b432-a3b6b944d1db None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:29.563241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bc8d9-ece3-4252-9cbf-d407820454fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:29.563890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bc8d9-ece3-4252-9cbf-d407820454fe None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:29.564168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bc8d9-ece3-4252-9cbf-d407820454fe None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:29.564439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bc8d9-ece3-4252-9cbf-d407820454fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:29.585104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bc8d9-ece3-4252-9cbf-d407820454fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:29.586588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bc8d9-ece3-4252-9cbf-d407820454fe None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-222bc8d9-ece3-4252-9cbf-d407820454fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:29.611364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:29.612587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:29.615647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:29.615647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:29.615647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:29.615647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 272/548] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:29.619446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f485a7-e3a5-4a60-88d4-5d13ccb878d4 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:29.684765 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:29.775778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f485a7-e3a5-4a60-88d4-5d13ccb878d4 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:29.821931 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9581d35-7ee8-4bb1-a2a2-903bd93bae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:29.822570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9581d35-7ee8-4bb1-a2a2-903bd93bae5a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:29.822856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9581d35-7ee8-4bb1-a2a2-903bd93bae5a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:29.823214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9581d35-7ee8-4bb1-a2a2-903bd93bae5a None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:29.824059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9581d35-7ee8-4bb1-a2a2-903bd93bae5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:29.824409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9581d35-7ee8-4bb1-a2a2-903bd93bae5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:29.826015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9581d35-7ee8-4bb1-a2a2-903bd93bae5a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:29.842941 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 277/549] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:29.849066 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bc8d9-ece3-4252-9cbf-d407820454fe None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:29.957960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9581d35-7ee8-4bb1-a2a2-903bd93bae5a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:30.026080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bc8d9-ece3-4252-9cbf-d407820454fe None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:30.073914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:30.095080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b08af-d8b2-4645-b673-f6f58cca8dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:30.096061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b08af-d8b2-4645-b673-f6f58cca8dfd None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:30.096493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b08af-d8b2-4645-b673-f6f58cca8dfd None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:30.097434 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b08af-d8b2-4645-b673-f6f58cca8dfd None admin] PATH_INFO: `/v3/users/swift` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:30.115887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b08af-d8b2-4645-b673-f6f58cca8dfd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:30.119037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b08af-d8b2-4645-b673-f6f58cca8dfd None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-132b08af-d8b2-4645-b673-f6f58cca8dfd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:30.142152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:30.143422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:30.144812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 273/550] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:30.153428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b08af-d8b2-4645-b673-f6f58cca8dfd None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:30.229486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:30.237017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9581d35-7ee8-4bb1-a2a2-903bd93bae5a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:30.309568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c99390-1723-4f51-8170-9e2862943ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:30.310197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99390-1723-4f51-8170-9e2862943ee1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:30.310527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99390-1723-4f51-8170-9e2862943ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:30.310894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99390-1723-4f51-8170-9e2862943ee1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:30.324588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c99390-1723-4f51-8170-9e2862943ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-d1c99390-1723-4f51-8170-9e2862943ee1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:30.330213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:30.332580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:30.334258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:30.340539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 278/551] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:30.340834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b08af-d8b2-4645-b673-f6f58cca8dfd None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:30.340999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f15e86-3db9-4aa5-9552-6a3ffd4c30a5 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:30.340999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f15e86-3db9-4aa5-9552-6a3ffd4c30a5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:30.340999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f15e86-3db9-4aa5-9552-6a3ffd4c30a5 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:30.341952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 279/552] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:30.342859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f15e86-3db9-4aa5-9552-6a3ffd4c30a5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:30.389371 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef9bc2-e1b1-41d8-ae11-98a116d0afa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:30.390294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef9bc2-e1b1-41d8-ae11-98a116d0afa0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:30.390645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef9bc2-e1b1-41d8-ae11-98a116d0afa0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:30.390948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef9bc2-e1b1-41d8-ae11-98a116d0afa0 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:30.392205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef9bc2-e1b1-41d8-ae11-98a116d0afa0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:30.392796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef9bc2-e1b1-41d8-ae11-98a116d0afa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:30.394796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef9bc2-e1b1-41d8-ae11-98a116d0afa0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:30.430383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 274/553] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 15:37:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:30.433107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4401aff-167c-4ab1-869e-5f8b8e177a73 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:30.433545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4401aff-167c-4ab1-869e-5f8b8e177a73 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:30.433975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4401aff-167c-4ab1-869e-5f8b8e177a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:30.460164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d4401aff-167c-4ab1-869e-5f8b8e177a73 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:30.461665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d4401aff-167c-4ab1-869e-5f8b8e177a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:30.523476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f15e86-3db9-4aa5-9552-6a3ffd4c30a5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:30.526363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:30.566847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c14dd-ae75-4684-aa54-682b1814cbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:30.567776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c14dd-ae75-4684-aa54-682b1814cbde None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:30.568203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c14dd-ae75-4684-aa54-682b1814cbde None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:30.568692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c14dd-ae75-4684-aa54-682b1814cbde None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:30.569675 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c14dd-ae75-4684-aa54-682b1814cbde None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:30.570202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c14dd-ae75-4684-aa54-682b1814cbde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:30.571905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c14dd-ae75-4684-aa54-682b1814cbde None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:30.583840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 280/554] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:30.584996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c14dd-ae75-4684-aa54-682b1814cbde None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:30.597285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 275/555] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:30.599020 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4401aff-167c-4ab1-869e-5f8b8e177a73 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:30.611515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:30.730201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c14dd-ae75-4684-aa54-682b1814cbde None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:30.792800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4401aff-167c-4ab1-869e-5f8b8e177a73 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:30.857781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617e1f0-3f0b-41f7-b961-c533fc5029b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:30.858593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617e1f0-3f0b-41f7-b961-c533fc5029b6 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:30.859046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617e1f0-3f0b-41f7-b961-c533fc5029b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:30.859630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617e1f0-3f0b-41f7-b961-c533fc5029b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:30.861543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b98bf8-8f31-47d1-a192-51cbd7773f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:30.862853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98bf8-8f31-47d1-a192-51cbd7773f18 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:30.863504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98bf8-8f31-47d1-a192-51cbd7773f18 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:30.864676 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b98bf8-8f31-47d1-a192-51cbd7773f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:30.907521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b98bf8-8f31-47d1-a192-51cbd7773f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:30.909429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b98bf8-8f31-47d1-a192-51cbd7773f18 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-d4b98bf8-8f31-47d1-a192-51cbd7773f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:30.945928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:30.947672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:30.953704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:30.953704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:30.953704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:30.953704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 276/556] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:30.970010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b98bf8-8f31-47d1-a192-51cbd7773f18 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:30.997473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617e1f0-3f0b-41f7-b961-c533fc5029b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:30.999753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617e1f0-3f0b-41f7-b961-c533fc5029b6 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:31.024656 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:31.045078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:31.167476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 281/557] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:31.167476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617e1f0-3f0b-41f7-b961-c533fc5029b6 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:31.199161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b98bf8-8f31-47d1-a192-51cbd7773f18 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:31.253345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c301-b66e-4fb6-bca4-6db9d1337d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:31.254439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c301-b66e-4fb6-bca4-6db9d1337d88 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:31.254921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c301-b66e-4fb6-bca4-6db9d1337d88 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:31.255399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c301-b66e-4fb6-bca4-6db9d1337d88 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:31.256281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926c301-b66e-4fb6-bca4-6db9d1337d88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:31.256854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926c301-b66e-4fb6-bca4-6db9d1337d88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:31.258497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926c301-b66e-4fb6-bca4-6db9d1337d88 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:31.277851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 277/558] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:31.279225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c301-b66e-4fb6-bca4-6db9d1337d88 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:31.382026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617e1f0-3f0b-41f7-b961-c533fc5029b6 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:31.392899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:31.409653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:31.426531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c993e4-9ca8-4be3-a773-29751e9ff552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:31.427733 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c993e4-9ca8-4be3-a773-29751e9ff552 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:31.428235 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c993e4-9ca8-4be3-a773-29751e9ff552 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:31.428900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c993e4-9ca8-4be3-a773-29751e9ff552 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:31.429184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c301-b66e-4fb6-bca4-6db9d1337d88 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:31.446935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c993e4-9ca8-4be3-a773-29751e9ff552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-36c993e4-9ca8-4be3-a773-29751e9ff552 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:31.454020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:31.455199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:31.456091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:31.466405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 282/559] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:31.467811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c993e4-9ca8-4be3-a773-29751e9ff552 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:31.503484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1850b4d-4b7a-4a1c-917b-9b173c8f7477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:31.504764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1850b4d-4b7a-4a1c-917b-9b173c8f7477 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:31.505773 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1850b4d-4b7a-4a1c-917b-9b173c8f7477 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:31.506180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1850b4d-4b7a-4a1c-917b-9b173c8f7477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:31.530552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1850b4d-4b7a-4a1c-917b-9b173c8f7477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:31.533143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1850b4d-4b7a-4a1c-917b-9b173c8f7477 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-e1850b4d-4b7a-4a1c-917b-9b173c8f7477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:31.564568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:31.565690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:31.566579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:31.566579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:31.566579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:31.573099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 278/560] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:31.574761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1850b4d-4b7a-4a1c-917b-9b173c8f7477 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:31.631047 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c993e4-9ca8-4be3-a773-29751e9ff552 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:31.672454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101add5-1cd6-405d-80c1-4e00eeb0d7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:31.673129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101add5-1cd6-405d-80c1-4e00eeb0d7a3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:31.673409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101add5-1cd6-405d-80c1-4e00eeb0d7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:31.673682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101add5-1cd6-405d-80c1-4e00eeb0d7a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:31.682367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101add5-1cd6-405d-80c1-4e00eeb0d7a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:31.683742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101add5-1cd6-405d-80c1-4e00eeb0d7a3 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-4101add5-1cd6-405d-80c1-4e00eeb0d7a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:31.696367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:31.708477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 283/561] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:31.709701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101add5-1cd6-405d-80c1-4e00eeb0d7a3 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:31.721670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1850b4d-4b7a-4a1c-917b-9b173c8f7477 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:31.754348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:31.760806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfb593-cd35-4c37-964d-f0446d2539fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:31.761411 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb593-cd35-4c37-964d-f0446d2539fa None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:31.761686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb593-cd35-4c37-964d-f0446d2539fa None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:31.762050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb593-cd35-4c37-964d-f0446d2539fa None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:31.763203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb593-cd35-4c37-964d-f0446d2539fa None admin] RBAC: Adding query filter params (name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:31.763510 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb593-cd35-4c37-964d-f0446d2539fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:31.764898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb593-cd35-4c37-964d-f0446d2539fa None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:31.767201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:31.775321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 279/562] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:31.776823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaae00-393f-4b05-a1ca-2b5b1a46c5b5 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:31.777103 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaae00-393f-4b05-a1ca-2b5b1a46c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:31.777369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaae00-393f-4b05-a1ca-2b5b1a46c5b5 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:31.778769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 280/563] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:31.779434 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaae00-393f-4b05-a1ca-2b5b1a46c5b5 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:31.822690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101add5-1cd6-405d-80c1-4e00eeb0d7a3 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:31.863608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb4716-3c2f-466a-8c35-cc716a85ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:31.864229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb4716-3c2f-466a-8c35-cc716a85ac98 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:31.864538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb4716-3c2f-466a-8c35-cc716a85ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:31.864816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb4716-3c2f-466a-8c35-cc716a85ac98 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:31.865463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb4716-3c2f-466a-8c35-cc716a85ac98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:31.865767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb4716-3c2f-466a-8c35-cc716a85ac98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:31.867146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb4716-3c2f-466a-8c35-cc716a85ac98 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:31.881135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 284/564] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:31.882522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9239f-5958-4b70-9568-281a4d177345 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:31.882838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9239f-5958-4b70-9568-281a4d177345 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:31.883134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9239f-5958-4b70-9568-281a4d177345 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:31.885180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 285/565] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:31.885956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9239f-5958-4b70-9568-281a4d177345 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:31.899201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaae00-393f-4b05-a1ca-2b5b1a46c5b5 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:31.940577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52531fe7-edd3-40ff-aa26-87a7fb547662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:31.941093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52531fe7-edd3-40ff-aa26-87a7fb547662 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:31.941376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52531fe7-edd3-40ff-aa26-87a7fb547662 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:31.941649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52531fe7-edd3-40ff-aa26-87a7fb547662 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:31.942389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52531fe7-edd3-40ff-aa26-87a7fb547662 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:31.942695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52531fe7-edd3-40ff-aa26-87a7fb547662 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:31.944142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52531fe7-edd3-40ff-aa26-87a7fb547662 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:31.962641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 281/566] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 15:37:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:31.963782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61749-2df0-40ff-be2f-96ad22300c78 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:31.964061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61749-2df0-40ff-be2f-96ad22300c78 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:31.964334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61749-2df0-40ff-be2f-96ad22300c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:31.983705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-93c61749-2df0-40ff-be2f-96ad22300c78 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:31.984971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-93c61749-2df0-40ff-be2f-96ad22300c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:32.002701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:32.006857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9239f-5958-4b70-9568-281a4d177345 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:32.040868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:32.042111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985f71c-a164-4979-9ffb-4d40cc5f1f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:32.042900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985f71c-a164-4979-9ffb-4d40cc5f1f1f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:32.043500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985f71c-a164-4979-9ffb-4d40cc5f1f1f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:32.043950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985f71c-a164-4979-9ffb-4d40cc5f1f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:32.055399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985f71c-a164-4979-9ffb-4d40cc5f1f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:32.057769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985f71c-a164-4979-9ffb-4d40cc5f1f1f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:32.059518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 282/567] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:32.060373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61749-2df0-40ff-be2f-96ad22300c78 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-f985f71c-a164-4979-9ffb-4d40cc5f1f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:32.073743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:32.074820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:32.076065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:32.076065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:32.076065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:32.076065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 286/568] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:32.076065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04182b-eb7d-4b00-a0bd-c79a296b8fb5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:32.076565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04182b-eb7d-4b00-a0bd-c79a296b8fb5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:32.076683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04182b-eb7d-4b00-a0bd-c79a296b8fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:32.097456 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-ec04182b-eb7d-4b00-a0bd-c79a296b8fb5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:32.098955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ec04182b-eb7d-4b00-a0bd-c79a296b8fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:32.188564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 287/569] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:32.188564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04182b-eb7d-4b00-a0bd-c79a296b8fb5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:32.219704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61749-2df0-40ff-be2f-96ad22300c78 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:32.283749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf952272-e237-451f-beb5-1561c4477531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:32.285167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf952272-e237-451f-beb5-1561c4477531 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:32.285518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf952272-e237-451f-beb5-1561c4477531 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:32.285862 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf952272-e237-451f-beb5-1561c4477531 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:32.296877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf952272-e237-451f-beb5-1561c4477531 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:32.299308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf952272-e237-451f-beb5-1561c4477531 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:32.305417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-bf952272-e237-451f-beb5-1561c4477531 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:32.317805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:32.319843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:32.321076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:32.321076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:32.321076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:32.321076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:32.321076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:32.321076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:32.321076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:32.321076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:32.322999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 283/570] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:32.325036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf952272-e237-451f-beb5-1561c4477531 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:32.330176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04182b-eb7d-4b00-a0bd-c79a296b8fb5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:32.371432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0655b1-174e-4e8a-b0bb-0885ced350b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:32.372091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0655b1-174e-4e8a-b0bb-0885ced350b0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:32.372373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0655b1-174e-4e8a-b0bb-0885ced350b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:32.372681 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0655b1-174e-4e8a-b0bb-0885ced350b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:32.384769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0655b1-174e-4e8a-b0bb-0885ced350b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:32.386307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0655b1-174e-4e8a-b0bb-0885ced350b0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:32.395347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-dd0655b1-174e-4e8a-b0bb-0885ced350b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:32.402849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:32.403874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:32.404818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:32.404818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:32.404818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:32.404818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 288/571] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:32.405053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0655b1-174e-4e8a-b0bb-0885ced350b0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:32.467391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf952272-e237-451f-beb5-1561c4477531 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:32.510798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cca6e-254e-4647-b9c8-73186f9ab2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:32.511414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cca6e-254e-4647-b9c8-73186f9ab2a9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:32.511690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cca6e-254e-4647-b9c8-73186f9ab2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:32.511960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cca6e-254e-4647-b9c8-73186f9ab2a9 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:32.512658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cca6e-254e-4647-b9c8-73186f9ab2a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:32.512967 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cca6e-254e-4647-b9c8-73186f9ab2a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:32.514363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cca6e-254e-4647-b9c8-73186f9ab2a9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:32.527358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 284/572] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:32.528371 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cca6e-254e-4647-b9c8-73186f9ab2a9 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:32.536666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0655b1-174e-4e8a-b0bb-0885ced350b0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:32.577536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9d85-31f0-4742-99bf-2ccab1178a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:32.578154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9d85-31f0-4742-99bf-2ccab1178a70 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:32.578462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9d85-31f0-4742-99bf-2ccab1178a70 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:32.578777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9d85-31f0-4742-99bf-2ccab1178a70 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:32.579767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9d85-31f0-4742-99bf-2ccab1178a70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:32.580151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9d85-31f0-4742-99bf-2ccab1178a70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:32.581859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9d85-31f0-4742-99bf-2ccab1178a70 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:32.584268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:32.599956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 289/573] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:32.600936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9d85-31f0-4742-99bf-2ccab1178a70 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:32.652812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cca6e-254e-4647-b9c8-73186f9ab2a9 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:32.660370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:32.690080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b07c68-30ca-4afa-a98b-69895703fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:32.690873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07c68-30ca-4afa-a98b-69895703fe52 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:32.691157 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07c68-30ca-4afa-a98b-69895703fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:32.691424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07c68-30ca-4afa-a98b-69895703fe52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:32.706419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b07c68-30ca-4afa-a98b-69895703fe52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-95b07c68-30ca-4afa-a98b-69895703fe52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:32.712705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:32.714546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 285/574] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:32.716222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b07c68-30ca-4afa-a98b-69895703fe52 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:32.717818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9d85-31f0-4742-99bf-2ccab1178a70 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:32.815867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f15f6-ffe5-47b6-b414-23c484a48d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:32.816886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f15f6-ffe5-47b6-b414-23c484a48d5b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:32.816886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f15f6-ffe5-47b6-b414-23c484a48d5b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:32.817192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f15f6-ffe5-47b6-b414-23c484a48d5b None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:32.817674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f15f6-ffe5-47b6-b414-23c484a48d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:32.817978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f15f6-ffe5-47b6-b414-23c484a48d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:32.819494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f15f6-ffe5-47b6-b414-23c484a48d5b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:32.833241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 290/575] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:32.833869 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f15f6-ffe5-47b6-b414-23c484a48d5b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:32.866774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b07c68-30ca-4afa-a98b-69895703fe52 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:32.905480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38112b-1c4f-4af5-9c20-5c6ffdc35f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:32.906146 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38112b-1c4f-4af5-9c20-5c6ffdc35f20 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:32.906420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38112b-1c4f-4af5-9c20-5c6ffdc35f20 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:32.906824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38112b-1c4f-4af5-9c20-5c6ffdc35f20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:32.913602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:32.919183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38112b-1c4f-4af5-9c20-5c6ffdc35f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-8b38112b-1c4f-4af5-9c20-5c6ffdc35f20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:32.924976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:32.931238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 286/576] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:32.932117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38112b-1c4f-4af5-9c20-5c6ffdc35f20 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:32.966578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:32.973808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f15f6-ffe5-47b6-b414-23c484a48d5b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:33.016264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a098b-15d6-4b68-bb8c-f72bd69ed21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:33.017041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a098b-15d6-4b68-bb8c-f72bd69ed21e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:33.017325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a098b-15d6-4b68-bb8c-f72bd69ed21e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:33.017758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a098b-15d6-4b68-bb8c-f72bd69ed21e None admin] PATH_INFO: `/v3/users/nova` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:33.027076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a098b-15d6-4b68-bb8c-f72bd69ed21e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:33.030884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a098b-15d6-4b68-bb8c-f72bd69ed21e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-194a098b-15d6-4b68-bb8c-f72bd69ed21e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:33.041571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:33.042627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 291/577] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 15:37:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:33.043589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a098b-15d6-4b68-bb8c-f72bd69ed21e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:33.053091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38112b-1c4f-4af5-9c20-5c6ffdc35f20 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:33.096141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c85c5a-4eeb-45dc-ae6c-4c2d3009ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:33.096763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c85c5a-4eeb-45dc-ae6c-4c2d3009ef3e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:33.097070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c85c5a-4eeb-45dc-ae6c-4c2d3009ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:33.097359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c85c5a-4eeb-45dc-ae6c-4c2d3009ef3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:33.098047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c85c5a-4eeb-45dc-ae6c-4c2d3009ef3e None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=92bc91b8b5224bd18f79bd8ea4663d3f) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:33.098384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c85c5a-4eeb-45dc-ae6c-4c2d3009ef3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:33.099842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c85c5a-4eeb-45dc-ae6c-4c2d3009ef3e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:33.106063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 287/578] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:32 2022] GET /identity/v3/role_assignments?user.id=92bc91b8b5224bd18f79bd8ea4663d3f&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:33.106964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c85c5a-4eeb-45dc-ae6c-4c2d3009ef3e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:33.196141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a098b-15d6-4b68-bb8c-f72bd69ed21e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:33.217199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:33.243015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5b5e7-6b88-4990-9d6d-e1ed548733ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:33.244458 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5b5e7-6b88-4990-9d6d-e1ed548733ef None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:33.250632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5b5e7-6b88-4990-9d6d-e1ed548733ef None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:33.250632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5b5e7-6b88-4990-9d6d-e1ed548733ef None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:33.250632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5b5e7-6b88-4990-9d6d-e1ed548733ef None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:33.250632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5b5e7-6b88-4990-9d6d-e1ed548733ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:33.251020 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:33.251112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5b5e7-6b88-4990-9d6d-e1ed548733ef None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:33.258707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 292/579] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:33.259650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c85c5a-4eeb-45dc-ae6c-4c2d3009ef3e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:33.260302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5b5e7-6b88-4990-9d6d-e1ed548733ef None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:33.304587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd43d0-e9a4-44f8-9a78-190bae64d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:33.305496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd43d0-e9a4-44f8-9a78-190bae64d007 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:33.306618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd43d0-e9a4-44f8-9a78-190bae64d007 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:33.307048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd43d0-e9a4-44f8-9a78-190bae64d007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:33.316432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd43d0-e9a4-44f8-9a78-190bae64d007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:33.318574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd43d0-e9a4-44f8-9a78-190bae64d007 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-1bfd43d0-e9a4-44f8-9a78-190bae64d007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:33.333413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:33.334605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:33.335778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:33.335778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:33.335778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:33.335778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:33.335778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:33.335778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:33.335778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:33.335778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:33.337579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 288/580] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:33.344292 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd43d0-e9a4-44f8-9a78-190bae64d007 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:33.402718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5b5e7-6b88-4990-9d6d-e1ed548733ef None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:33.456134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef780d8-b70f-4d38-b6bb-7235beae51b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:33.457280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef780d8-b70f-4d38-b6bb-7235beae51b1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:33.457737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef780d8-b70f-4d38-b6bb-7235beae51b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:33.458149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef780d8-b70f-4d38-b6bb-7235beae51b1 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:33.459230 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef780d8-b70f-4d38-b6bb-7235beae51b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:33.459839 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef780d8-b70f-4d38-b6bb-7235beae51b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:33.462477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef780d8-b70f-4d38-b6bb-7235beae51b1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:33.482783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 293/581] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:33.482783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef780d8-b70f-4d38-b6bb-7235beae51b1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:33.495094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd43d0-e9a4-44f8-9a78-190bae64d007 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:33.539924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:33.543586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad776c-a6d6-4652-9149-8c77e0ba32bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:33.544208 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad776c-a6d6-4652-9149-8c77e0ba32bf None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:33.544485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad776c-a6d6-4652-9149-8c77e0ba32bf None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:33.544790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad776c-a6d6-4652-9149-8c77e0ba32bf None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:33.545839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad776c-a6d6-4652-9149-8c77e0ba32bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:33.546353 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad776c-a6d6-4652-9149-8c77e0ba32bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:33.548334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad776c-a6d6-4652-9149-8c77e0ba32bf None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:33.580907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 289/582] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 15:37:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:33.580907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad776c-a6d6-4652-9149-8c77e0ba32bf None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:33.591170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:33.650790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef780d8-b70f-4d38-b6bb-7235beae51b1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:33.692624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5dddc-e1ad-4f7f-a33c-2e7402f735d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:33.693499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dddc-e1ad-4f7f-a33c-2e7402f735d0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:33.693854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dddc-e1ad-4f7f-a33c-2e7402f735d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:33.694130 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dddc-e1ad-4f7f-a33c-2e7402f735d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:33.707544 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5dddc-e1ad-4f7f-a33c-2e7402f735d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:33.709074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5dddc-e1ad-4f7f-a33c-2e7402f735d0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:33.722134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad776c-a6d6-4652-9149-8c77e0ba32bf None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-ffc5dddc-e1ad-4f7f-a33c-2e7402f735d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:33.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:33.727295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:33.729266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:33.729266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:33.729266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:33.729266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 294/583] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:33.729266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5dddc-e1ad-4f7f-a33c-2e7402f735d0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:33.778283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ae19d-e02e-400b-878d-18ae9227972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:33.779135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ae19d-e02e-400b-878d-18ae9227972a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:33.779428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ae19d-e02e-400b-878d-18ae9227972a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:33.779698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ae19d-e02e-400b-878d-18ae9227972a None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:33.780407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ae19d-e02e-400b-878d-18ae9227972a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:33.780749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ae19d-e02e-400b-878d-18ae9227972a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:33.782394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ae19d-e02e-400b-878d-18ae9227972a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:33.800205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 290/584] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:33.802514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ae19d-e02e-400b-878d-18ae9227972a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:33.861571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:33.873084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5dddc-e1ad-4f7f-a33c-2e7402f735d0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:33.912882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:33.921319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed120cb-f432-41b4-968e-002b8b93e883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:33.922007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed120cb-f432-41b4-968e-002b8b93e883 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:33.922298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed120cb-f432-41b4-968e-002b8b93e883 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:33.922510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed120cb-f432-41b4-968e-002b8b93e883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:33.934763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed120cb-f432-41b4-968e-002b8b93e883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:33.936235 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed120cb-f432-41b4-968e-002b8b93e883 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-0ed120cb-f432-41b4-968e-002b8b93e883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:33.952892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:33.953966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:33.955607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:33.955607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:33.955607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:33.955607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 295/585] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:33.955607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed120cb-f432-41b4-968e-002b8b93e883 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:33.976098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ae19d-e02e-400b-878d-18ae9227972a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:34.028046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1bf07-7851-477a-965e-ee9eed04b5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:34.028734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1bf07-7851-477a-965e-ee9eed04b5cf None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:34.029047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1bf07-7851-477a-965e-ee9eed04b5cf None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:34.029301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1bf07-7851-477a-965e-ee9eed04b5cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:34.043037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1bf07-7851-477a-965e-ee9eed04b5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:34.044874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1bf07-7851-477a-965e-ee9eed04b5cf None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-5ef1bf07-7851-477a-965e-ee9eed04b5cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:34.062286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:34.063532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:34.064459 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:34.064459 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:34.064459 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:34.064459 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 291/586] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:34.064459 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1bf07-7851-477a-965e-ee9eed04b5cf None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:34.100895 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed120cb-f432-41b4-968e-002b8b93e883 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:34.154021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a67e68-0e12-45d9-bc8c-62f6354d8597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:34.154670 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a67e68-0e12-45d9-bc8c-62f6354d8597 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:34.154940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a67e68-0e12-45d9-bc8c-62f6354d8597 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:34.155331 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a67e68-0e12-45d9-bc8c-62f6354d8597 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:34.156014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a67e68-0e12-45d9-bc8c-62f6354d8597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:34.156313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a67e68-0e12-45d9-bc8c-62f6354d8597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:34.157808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a67e68-0e12-45d9-bc8c-62f6354d8597 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:34.177992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 296/587] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:34.177992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a67e68-0e12-45d9-bc8c-62f6354d8597 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:34.178930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:34.217954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1bf07-7851-477a-965e-ee9eed04b5cf None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:34.247513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:34.264767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612972-2e86-4802-84aa-5698d4ec3296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:34.265439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612972-2e86-4802-84aa-5698d4ec3296 None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:34.265715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612972-2e86-4802-84aa-5698d4ec3296 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:34.265987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4612972-2e86-4802-84aa-5698d4ec3296 None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/d8d073f3152f4825becf78c24539477e/roles/3713b2e0c4f04c8cad78881a656528e6` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:34.289687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4612972-2e86-4802-84aa-5698d4ec3296 None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=d8d073f3152f4825becf78c24539477e, role_id=3713b2e0c4f04c8cad78881a656528e6)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:34.292245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4612972-2e86-4802-84aa-5698d4ec3296 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:34.339218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a67e68-0e12-45d9-bc8c-62f6354d8597 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:34.369026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 292/588] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:37:34 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/d8d073f3152f4825becf78c24539477e/roles/3713b2e0c4f04c8cad78881a656528e6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:37:34.369897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612972-2e86-4802-84aa-5698d4ec3296 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:34.404568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea56002-765d-4fb1-bb00-de14fc86e8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:34.405497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea56002-765d-4fb1-bb00-de14fc86e8f8 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:34.406145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea56002-765d-4fb1-bb00-de14fc86e8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:34.407044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea56002-765d-4fb1-bb00-de14fc86e8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:34.408209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea56002-765d-4fb1-bb00-de14fc86e8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:34.408789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea56002-765d-4fb1-bb00-de14fc86e8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:34.410622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea56002-765d-4fb1-bb00-de14fc86e8f8 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:34.429309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 297/589] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:34.430529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea56002-765d-4fb1-bb00-de14fc86e8f8 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:34.498892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4612972-2e86-4802-84aa-5698d4ec3296 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:34.526477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:34.547524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05d3b3-245f-4fd3-9c32-717fb160396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:34.548154 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05d3b3-245f-4fd3-9c32-717fb160396f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:34.548429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05d3b3-245f-4fd3-9c32-717fb160396f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:34.548767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05d3b3-245f-4fd3-9c32-717fb160396f None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:34.550418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05d3b3-245f-4fd3-9c32-717fb160396f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:34.550751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05d3b3-245f-4fd3-9c32-717fb160396f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:34.552678 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05d3b3-245f-4fd3-9c32-717fb160396f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:34.568900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 293/590] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:34.570494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05d3b3-245f-4fd3-9c32-717fb160396f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:34.593569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea56002-765d-4fb1-bb00-de14fc86e8f8 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:34.622763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:34.656864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e60cf-ee99-4a37-87d0-14e6060a70ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:34.657565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e60cf-ee99-4a37-87d0-14e6060a70ef None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:34.657843 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e60cf-ee99-4a37-87d0-14e6060a70ef None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:34.658113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e60cf-ee99-4a37-87d0-14e6060a70ef None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:34.668987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e60cf-ee99-4a37-87d0-14e6060a70ef None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:34.670596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e60cf-ee99-4a37-87d0-14e6060a70ef None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-438e60cf-ee99-4a37-87d0-14e6060a70ef None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:34.685291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:34.686608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:34.687557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 298/591] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:34.688556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e60cf-ee99-4a37-87d0-14e6060a70ef None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:34.720978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05d3b3-245f-4fd3-9c32-717fb160396f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:34.763567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2988d-28c4-431f-bf31-df7b684b01cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:34.765012 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2988d-28c4-431f-bf31-df7b684b01cd None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:34.765496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2988d-28c4-431f-bf31-df7b684b01cd None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:34.766660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2988d-28c4-431f-bf31-df7b684b01cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:34.776386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2988d-28c4-431f-bf31-df7b684b01cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:34.778199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2988d-28c4-431f-bf31-df7b684b01cd None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-52f2988d-28c4-431f-bf31-df7b684b01cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:34.795334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:34.797022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:34.798487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:34.798487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:34.798487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:34.798487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:34.798487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:34.798487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:34.798487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:34.798487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:34.798487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:37:34.798487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:34.801908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 294/592] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:34.803127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2988d-28c4-431f-bf31-df7b684b01cd None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:34.832865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e60cf-ee99-4a37-87d0-14e6060a70ef None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:34.881702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:34.900708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81e73c-d96f-433e-8eca-16a6d4158dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:34.901362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81e73c-d96f-433e-8eca-16a6d4158dba None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:34.901688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81e73c-d96f-433e-8eca-16a6d4158dba None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:34.901946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81e73c-d96f-433e-8eca-16a6d4158dba None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:34.911666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81e73c-d96f-433e-8eca-16a6d4158dba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:34.913174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81e73c-d96f-433e-8eca-16a6d4158dba None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-9d81e73c-d96f-433e-8eca-16a6d4158dba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:34.933568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:34.935070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:34.937356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:34.937356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:34.937356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:34.937356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:34.937356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:34.937356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:34.937356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:34.937356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:34.939932 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 299/593] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:34.941206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81e73c-d96f-433e-8eca-16a6d4158dba None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:34.960957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:34.976060 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2988d-28c4-431f-bf31-df7b684b01cd None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:35.020394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666828e2-9677-4e53-b302-6f3c04d4788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:35.021843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666828e2-9677-4e53-b302-6f3c04d4788c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:35.022572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666828e2-9677-4e53-b302-6f3c04d4788c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:35.023276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666828e2-9677-4e53-b302-6f3c04d4788c None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:35.025399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666828e2-9677-4e53-b302-6f3c04d4788c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:35.026188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666828e2-9677-4e53-b302-6f3c04d4788c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:35.028961 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666828e2-9677-4e53-b302-6f3c04d4788c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:35.057385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 295/594] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Aug 22 15:37:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:35.059288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666828e2-9677-4e53-b302-6f3c04d4788c None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:35.123068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81e73c-d96f-433e-8eca-16a6d4158dba None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:35.183770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9302a52-dc6f-415d-acc2-eb52d53eef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:35.185489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9302a52-dc6f-415d-acc2-eb52d53eef02 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:35.185683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9302a52-dc6f-415d-acc2-eb52d53eef02 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:35.186162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9302a52-dc6f-415d-acc2-eb52d53eef02 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:35.187510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9302a52-dc6f-415d-acc2-eb52d53eef02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:35.188116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9302a52-dc6f-415d-acc2-eb52d53eef02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:35.190830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9302a52-dc6f-415d-acc2-eb52d53eef02 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:35.230899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 300/595] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 15:37:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:35.230899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9302a52-dc6f-415d-acc2-eb52d53eef02 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:35.259909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666828e2-9677-4e53-b302-6f3c04d4788c None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:35.310672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:35.349211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf95776-de37-4fbc-b2c2-38ccb85a7c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:35.350182 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf95776-de37-4fbc-b2c2-38ccb85a7c23 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:35.350640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf95776-de37-4fbc-b2c2-38ccb85a7c23 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:35.351085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf95776-de37-4fbc-b2c2-38ccb85a7c23 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:35.352281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf95776-de37-4fbc-b2c2-38ccb85a7c23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:35.357097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf95776-de37-4fbc-b2c2-38ccb85a7c23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:35.364088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf95776-de37-4fbc-b2c2-38ccb85a7c23 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:35.384681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 296/596] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:35.384681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf95776-de37-4fbc-b2c2-38ccb85a7c23 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:35.403765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:35.434618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9302a52-dc6f-415d-acc2-eb52d53eef02 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:35.496989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd147b8-0ebd-4093-8815-78d75400eb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:35.499264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd147b8-0ebd-4093-8815-78d75400eb2a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:35.500221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd147b8-0ebd-4093-8815-78d75400eb2a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:35.500903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd147b8-0ebd-4093-8815-78d75400eb2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:35.523489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf95776-de37-4fbc-b2c2-38ccb85a7c23 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:35.525295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd147b8-0ebd-4093-8815-78d75400eb2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:35.529701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd147b8-0ebd-4093-8815-78d75400eb2a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-6cd147b8-0ebd-4093-8815-78d75400eb2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:35.553676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:35.556140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:35.558096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:35.558096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:35.558096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:35.560844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 301/597] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:35.563019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd7479-2cd4-426b-9f42-3c07f2584d69 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:35.563464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd7479-2cd4-426b-9f42-3c07f2584d69 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:35.563895 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd7479-2cd4-426b-9f42-3c07f2584d69 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:35.567510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 302/598] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:35.573550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd7479-2cd4-426b-9f42-3c07f2584d69 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:35.596672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8bfa5-a395-4147-8ccd-a6d672992dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:35.597688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bfa5-a395-4147-8ccd-a6d672992dbb None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:35.598105 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bfa5-a395-4147-8ccd-a6d672992dbb None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:35.598734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bfa5-a395-4147-8ccd-a6d672992dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:35.621788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8bfa5-a395-4147-8ccd-a6d672992dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:35.624693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8bfa5-a395-4147-8ccd-a6d672992dbb None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-ead8bfa5-a395-4147-8ccd-a6d672992dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:35.644848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:35.645969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:35.646887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:35.646887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:35.646887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:35.648854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 297/599] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:35.649985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8bfa5-a395-4147-8ccd-a6d672992dbb None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:35.749182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:35.761803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd7479-2cd4-426b-9f42-3c07f2584d69 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:35.769479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:35.822227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f5eb0-f98f-4668-aca9-8d581220c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:35.822965 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f5eb0-f98f-4668-aca9-8d581220c86e None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:35.824042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f5eb0-f98f-4668-aca9-8d581220c86e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:35.824332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f5eb0-f98f-4668-aca9-8d581220c86e None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/1c12495a6cf64c80b45785f185f28383/roles/3713b2e0c4f04c8cad78881a656528e6` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:35.843083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8bfa5-a395-4147-8ccd-a6d672992dbb None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:35.848057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f5eb0-f98f-4668-aca9-8d581220c86e None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=1c12495a6cf64c80b45785f185f28383, role_id=3713b2e0c4f04c8cad78881a656528e6)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:35.849567 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f5eb0-f98f-4668-aca9-8d581220c86e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:35.898961 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7cae9-0730-492d-ab78-2292a549a9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:35.899892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7cae9-0730-492d-ab78-2292a549a9e9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:35.900285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7cae9-0730-492d-ab78-2292a549a9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:35.900740 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7cae9-0730-492d-ab78-2292a549a9e9 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:35.901850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7cae9-0730-492d-ab78-2292a549a9e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:35.902690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7cae9-0730-492d-ab78-2292a549a9e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:35.904365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7cae9-0730-492d-ab78-2292a549a9e9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:35.924240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 298/600] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:35.926335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc6bb-242a-4f3b-acb2-cb236bf20493 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:35.926717 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc6bb-242a-4f3b-acb2-cb236bf20493 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:35.927124 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc6bb-242a-4f3b-acb2-cb236bf20493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:35.952555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 303/601] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:37:35 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/1c12495a6cf64c80b45785f185f28383/roles/3713b2e0c4f04c8cad78881a656528e6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:37:35.952555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f5eb0-f98f-4668-aca9-8d581220c86e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:35.962929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-17ffc6bb-242a-4f3b-acb2-cb236bf20493 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:35.964978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-17ffc6bb-242a-4f3b-acb2-cb236bf20493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:36.099544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 299/602] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:36.101284 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffc6bb-242a-4f3b-acb2-cb236bf20493 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:36.139882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f5eb0-f98f-4668-aca9-8d581220c86e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:36.198256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b48192-e72f-4d9b-8231-9ae767e9662c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:36.199326 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b48192-e72f-4d9b-8231-9ae767e9662c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:36.199877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b48192-e72f-4d9b-8231-9ae767e9662c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:36.200491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b48192-e72f-4d9b-8231-9ae767e9662c None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:36.201466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b48192-e72f-4d9b-8231-9ae767e9662c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:36.201867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b48192-e72f-4d9b-8231-9ae767e9662c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:36.204066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b48192-e72f-4d9b-8231-9ae767e9662c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:36.205704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:36.222917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 304/603] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:36.231167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b48192-e72f-4d9b-8231-9ae767e9662c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:36.242450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:36.288081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffc6bb-242a-4f3b-acb2-cb236bf20493 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:36.348410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735c7df-4952-422b-b62e-d882745d82f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:36.350306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c7df-4952-422b-b62e-d882745d82f5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:36.351926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c7df-4952-422b-b62e-d882745d82f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:36.352218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c7df-4952-422b-b62e-d882745d82f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:36.366856 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735c7df-4952-422b-b62e-d882745d82f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:36.368419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735c7df-4952-422b-b62e-d882745d82f5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-f735c7df-4952-422b-b62e-d882745d82f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:36.393320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:36.394298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:36.395215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:36.395215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:36.395215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:36.395215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:36.395215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:36.395215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:36.395215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:36.395215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:36.395215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 300/604] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:36.401268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735c7df-4952-422b-b62e-d882745d82f5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:36.476039 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b48192-e72f-4d9b-8231-9ae767e9662c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:36.560280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735c7df-4952-422b-b62e-d882745d82f5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:36.578657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a11267-e2c5-4cee-8fef-80e4367f5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:36.579651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a11267-e2c5-4cee-8fef-80e4367f5f10 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:36.579811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:36.580101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a11267-e2c5-4cee-8fef-80e4367f5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:36.580582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a11267-e2c5-4cee-8fef-80e4367f5f10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:36.590985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a11267-e2c5-4cee-8fef-80e4367f5f10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:36.592777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a11267-e2c5-4cee-8fef-80e4367f5f10 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-90a11267-e2c5-4cee-8fef-80e4367f5f10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:36.606174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:36.607683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:36.610399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:36.610399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:36.610399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:36.610399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:36.610399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:36.610399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:36.610399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:36.610399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:36.610399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 305/605] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:36.610399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a11267-e2c5-4cee-8fef-80e4367f5f10 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:36.619291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597e40c-9052-48d0-bcf1-2b3360e8ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:36.620748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597e40c-9052-48d0-bcf1-2b3360e8ee82 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:36.621034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597e40c-9052-48d0-bcf1-2b3360e8ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:36.621300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597e40c-9052-48d0-bcf1-2b3360e8ee82 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:36.622468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597e40c-9052-48d0-bcf1-2b3360e8ee82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:36.623483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597e40c-9052-48d0-bcf1-2b3360e8ee82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:36.625972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597e40c-9052-48d0-bcf1-2b3360e8ee82 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:36.644705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 301/606] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:36.645699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597e40c-9052-48d0-bcf1-2b3360e8ee82 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:36.693319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:36.749973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a11267-e2c5-4cee-8fef-80e4367f5f10 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:36.814404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ffbf7-c06d-4878-b400-72836d71a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:36.815832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ffbf7-c06d-4878-b400-72836d71a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:36.816411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ffbf7-c06d-4878-b400-72836d71a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:36.817059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ffbf7-c06d-4878-b400-72836d71a5d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:36.837810 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ffbf7-c06d-4878-b400-72836d71a5d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-a05ffbf7-c06d-4878-b400-72836d71a5d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:36.844782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:36.846707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:36.848424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:36.850964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 306/607] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:36.852108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597e40c-9052-48d0-bcf1-2b3360e8ee82 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:36.852819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ffbf7-c06d-4878-b400-72836d71a5d8 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:36.913372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c72117-dc77-412b-b43a-82cfaafa6b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:36.914149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c72117-dc77-412b-b43a-82cfaafa6b1d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:36.914537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c72117-dc77-412b-b43a-82cfaafa6b1d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:36.914957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c72117-dc77-412b-b43a-82cfaafa6b1d None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:36.915872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c72117-dc77-412b-b43a-82cfaafa6b1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:36.916377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c72117-dc77-412b-b43a-82cfaafa6b1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:36.919285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c72117-dc77-412b-b43a-82cfaafa6b1d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:36.938147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 302/608] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:36.939239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c72117-dc77-412b-b43a-82cfaafa6b1d None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:36.984017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:37.034754 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ffbf7-c06d-4878-b400-72836d71a5d8 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:37.072081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:37.089101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c389a6a-daa6-4ff8-8eb9-3aa7e22e3e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:37.089899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c389a6a-daa6-4ff8-8eb9-3aa7e22e3e5d None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:37.090178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c389a6a-daa6-4ff8-8eb9-3aa7e22e3e5d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:37.090844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c389a6a-daa6-4ff8-8eb9-3aa7e22e3e5d None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/90324fa56d0743699f2fddd17fb630dd/roles/3713b2e0c4f04c8cad78881a656528e6` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:37.095858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c72117-dc77-412b-b43a-82cfaafa6b1d None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:37.111028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c389a6a-daa6-4ff8-8eb9-3aa7e22e3e5d None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=90324fa56d0743699f2fddd17fb630dd, role_id=3713b2e0c4f04c8cad78881a656528e6)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:37.113592 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c389a6a-daa6-4ff8-8eb9-3aa7e22e3e5d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:37.145736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187f41c-187f-406a-94b1-b982311ad903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:37.146360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187f41c-187f-406a-94b1-b982311ad903 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:37.146640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187f41c-187f-406a-94b1-b982311ad903 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:37.146910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187f41c-187f-406a-94b1-b982311ad903 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:37.147667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187f41c-187f-406a-94b1-b982311ad903 None admin] RBAC: Adding query filter params (name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:37.147976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187f41c-187f-406a-94b1-b982311ad903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:37.149454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187f41c-187f-406a-94b1-b982311ad903 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:37.163301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 303/609] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:37.163301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187f41c-187f-406a-94b1-b982311ad903 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:37.232866 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 307/610] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:37:36 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/90324fa56d0743699f2fddd17fb630dd/roles/3713b2e0c4f04c8cad78881a656528e6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:37:37.235152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074237d-06ac-40aa-a757-bd935e4b8fd0 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:37.235614 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074237d-06ac-40aa-a757-bd935e4b8fd0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:37.236087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074237d-06ac-40aa-a757-bd935e4b8fd0 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:37.238278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 308/611] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:37.239534 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074237d-06ac-40aa-a757-bd935e4b8fd0 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:37.326425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:37.338639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187f41c-187f-406a-94b1-b982311ad903 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:37.391054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaeeb2-db2c-45e2-b54a-46c7a327d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:37.391758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaeeb2-db2c-45e2-b54a-46c7a327d84e None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:37.392037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaeeb2-db2c-45e2-b54a-46c7a327d84e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:37.392311 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaeeb2-db2c-45e2-b54a-46c7a327d84e None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/c2de83ba29194578a9a229d5bab6612e/roles/3713b2e0c4f04c8cad78881a656528e6` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:37.418978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaeeb2-db2c-45e2-b54a-46c7a327d84e None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=c2de83ba29194578a9a229d5bab6612e, role_id=3713b2e0c4f04c8cad78881a656528e6)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:37.420456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaeeb2-db2c-45e2-b54a-46c7a327d84e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:37.453701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074237d-06ac-40aa-a757-bd935e4b8fd0 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:37.502456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 304/612] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:37:37 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/c2de83ba29194578a9a229d5bab6612e/roles/3713b2e0c4f04c8cad78881a656528e6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:37:37.504104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e802e-0585-42b8-a732-e067c854ca7b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:37.504410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e802e-0585-42b8-a732-e067c854ca7b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:37.504721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e802e-0585-42b8-a732-e067c854ca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:37.526037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8c2e802e-0585-42b8-a732-e067c854ca7b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:37.527437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8c2e802e-0585-42b8-a732-e067c854ca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:37.528110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd815-b271-41bf-9993-c7473e7db158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:37.529875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd815-b271-41bf-9993-c7473e7db158 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:37.531120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd815-b271-41bf-9993-c7473e7db158 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:37.531946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd815-b271-41bf-9993-c7473e7db158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:37.557466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cd815-b271-41bf-9993-c7473e7db158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:37.560757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cd815-b271-41bf-9993-c7473e7db158 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-910cd815-b271-41bf-9993-c7473e7db158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:37.595904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:37.596977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:37.597889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:37.597889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:37.597889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:37.598998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 309/613] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:37.606651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd815-b271-41bf-9993-c7473e7db158 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:37.642446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:37.683325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 305/614] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:37.744332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd815-b271-41bf-9993-c7473e7db158 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:37.785136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee75ee1-29c2-461d-b84b-dad857bb7303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:37.785684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75ee1-29c2-461d-b84b-dad857bb7303 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:37.786025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75ee1-29c2-461d-b84b-dad857bb7303 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:37.786300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75ee1-29c2-461d-b84b-dad857bb7303 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:37.787083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75ee1-29c2-461d-b84b-dad857bb7303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:37.787386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75ee1-29c2-461d-b84b-dad857bb7303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:37.788806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee75ee1-29c2-461d-b84b-dad857bb7303 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:37.803476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 310/615] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:37.809431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e802e-0585-42b8-a732-e067c854ca7b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:37.946795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:37.989718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e802e-0585-42b8-a732-e067c854ca7b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:38.007328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee75ee1-29c2-461d-b84b-dad857bb7303 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:38.046624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d8281-7a92-4cbd-959f-938b93c71f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:38.047185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d8281-7a92-4cbd-959f-938b93c71f80 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:38.047462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d8281-7a92-4cbd-959f-938b93c71f80 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:38.047730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d8281-7a92-4cbd-959f-938b93c71f80 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:38.061805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d8281-7a92-4cbd-959f-938b93c71f80 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:38.063300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d8281-7a92-4cbd-959f-938b93c71f80 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-519d8281-7a92-4cbd-959f-938b93c71f80 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:38.090825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:38.091887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:38.093052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 306/616] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:38.097915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d8281-7a92-4cbd-959f-938b93c71f80 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:38.128965 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:38.165355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee75ee1-29c2-461d-b84b-dad857bb7303 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:38.241545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c42e6-ea62-4f47-be2f-024971ce9bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:38.243740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c42e6-ea62-4f47-be2f-024971ce9bc9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:38.245818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c42e6-ea62-4f47-be2f-024971ce9bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:38.247300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c42e6-ea62-4f47-be2f-024971ce9bc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:38.273784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c42e6-ea62-4f47-be2f-024971ce9bc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-577c42e6-ea62-4f47-be2f-024971ce9bc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:38.281682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:38.282647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:38.283714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:38.289619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d8281-7a92-4cbd-959f-938b93c71f80 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:38.291220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 311/617] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:38.300526 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c42e6-ea62-4f47-be2f-024971ce9bc9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:38.357573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:38.369004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72e16-7c94-4f48-85b7-3bac917f1133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:38.373395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72e16-7c94-4f48-85b7-3bac917f1133 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:38.373952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72e16-7c94-4f48-85b7-3bac917f1133 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:38.374428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec72e16-7c94-4f48-85b7-3bac917f1133 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:38.375413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec72e16-7c94-4f48-85b7-3bac917f1133 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:38.377013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec72e16-7c94-4f48-85b7-3bac917f1133 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:38.384981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec72e16-7c94-4f48-85b7-3bac917f1133 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:38.423641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 307/618] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 15:37:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:38.427343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72e16-7c94-4f48-85b7-3bac917f1133 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:38.530131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c42e6-ea62-4f47-be2f-024971ce9bc9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:38.569900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf661f27-2e75-4bcc-b525-992a5b7c6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:38.570440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661f27-2e75-4bcc-b525-992a5b7c6f43 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:38.570725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661f27-2e75-4bcc-b525-992a5b7c6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:38.571684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf661f27-2e75-4bcc-b525-992a5b7c6f43 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:38.572481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf661f27-2e75-4bcc-b525-992a5b7c6f43 None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:38.572917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf661f27-2e75-4bcc-b525-992a5b7c6f43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:38.574317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf661f27-2e75-4bcc-b525-992a5b7c6f43 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:38.582830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec72e16-7c94-4f48-85b7-3bac917f1133 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:38.584130 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 312/619] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:38.585697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87480-d944-4d96-8cfe-e7d3aa6742bb None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:38.585985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87480-d944-4d96-8cfe-e7d3aa6742bb None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:38.586351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e87480-d944-4d96-8cfe-e7d3aa6742bb None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:38.592001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 313/620] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:38.593901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73373a7-86e4-4a75-abe6-6e6f3cd9f4e1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:38.594418 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73373a7-86e4-4a75-abe6-6e6f3cd9f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:38.594881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73373a7-86e4-4a75-abe6-6e6f3cd9f4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:38.612535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:38.621608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d73373a7-86e4-4a75-abe6-6e6f3cd9f4e1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:38.623183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d73373a7-86e4-4a75-abe6-6e6f3cd9f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:38.638697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3a467-3b93-4ea4-bec1-cb901741e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:38.639738 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3a467-3b93-4ea4-bec1-cb901741e239 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:38.640742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3a467-3b93-4ea4-bec1-cb901741e239 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:38.641294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3a467-3b93-4ea4-bec1-cb901741e239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:38.655696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3a467-3b93-4ea4-bec1-cb901741e239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:38.658498 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3a467-3b93-4ea4-bec1-cb901741e239 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-3cf3a467-3b93-4ea4-bec1-cb901741e239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:38.683194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:38.684234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:38.685253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:38.685253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:38.685253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:38.689441 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 308/621] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:38.690423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3a467-3b93-4ea4-bec1-cb901741e239 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:38.726513 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 314/622] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:38.728628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73373a7-86e4-4a75-abe6-6e6f3cd9f4e1 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:38.758566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:38.878175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3a467-3b93-4ea4-bec1-cb901741e239 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:38.904831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73373a7-86e4-4a75-abe6-6e6f3cd9f4e1 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:38.947090 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab04734-a264-493d-a99f-eefe9e839e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:38.947762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab04734-a264-493d-a99f-eefe9e839e67 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:38.948014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab04734-a264-493d-a99f-eefe9e839e67 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:38.948291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab04734-a264-493d-a99f-eefe9e839e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:38.949509 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080098-a1af-4099-bc46-545a9578fec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:38.950071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080098-a1af-4099-bc46-545a9578fec5 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:38.950348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080098-a1af-4099-bc46-545a9578fec5 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:38.950627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee080098-a1af-4099-bc46-545a9578fec5 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:38.951277 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee080098-a1af-4099-bc46-545a9578fec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:38.951637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee080098-a1af-4099-bc46-545a9578fec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:38.953054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee080098-a1af-4099-bc46-545a9578fec5 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:38.962720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:38.974222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab04734-a264-493d-a99f-eefe9e839e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:38.975686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab04734-a264-493d-a99f-eefe9e839e67 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:38.985720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 315/623] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:38.986383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080098-a1af-4099-bc46-545a9578fec5 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9ab04734-a264-493d-a99f-eefe9e839e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:38.999637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:39.000681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:39.001580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:39.001580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:39.001580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:39.003669 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 309/624] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:39.019226 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab04734-a264-493d-a99f-eefe9e839e67 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:39.104888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee080098-a1af-4099-bc46-545a9578fec5 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:39.144604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329afe80-436f-40db-ac97-682a57ee1ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:39.145590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329afe80-436f-40db-ac97-682a57ee1ac9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.146048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329afe80-436f-40db-ac97-682a57ee1ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.146502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329afe80-436f-40db-ac97-682a57ee1ac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.155129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329afe80-436f-40db-ac97-682a57ee1ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:39.156765 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329afe80-436f-40db-ac97-682a57ee1ac9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:39.169215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-329afe80-436f-40db-ac97-682a57ee1ac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:39.169395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:39.170298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:39.171199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:39.171199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:39.171199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:39.171199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:39.171199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:39.171199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:39.171199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:39.171199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:39.171199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 316/625] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:39.171809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329afe80-436f-40db-ac97-682a57ee1ac9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:39.178919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab04734-a264-493d-a99f-eefe9e839e67 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:39.232608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522d378-893b-4ca9-b565-fdceaff84fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:39.233650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522d378-893b-4ca9-b565-fdceaff84fa9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.233931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522d378-893b-4ca9-b565-fdceaff84fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.234299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522d378-893b-4ca9-b565-fdceaff84fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.234970 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522d378-893b-4ca9-b565-fdceaff84fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:39.235274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522d378-893b-4ca9-b565-fdceaff84fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:39.237039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522d378-893b-4ca9-b565-fdceaff84fa9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:39.245541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:39.258422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 310/626] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:39.260316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522d378-893b-4ca9-b565-fdceaff84fa9 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:39.294907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329afe80-436f-40db-ac97-682a57ee1ac9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:39.334506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222eebc9-c7bc-4acc-a4af-b6a4ed3a5820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:39.335586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222eebc9-c7bc-4acc-a4af-b6a4ed3a5820 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.336238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222eebc9-c7bc-4acc-a4af-b6a4ed3a5820 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.336790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222eebc9-c7bc-4acc-a4af-b6a4ed3a5820 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.352026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222eebc9-c7bc-4acc-a4af-b6a4ed3a5820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-222eebc9-c7bc-4acc-a4af-b6a4ed3a5820 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:39.359868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:39.360919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:39.361776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:39.364585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 317/627] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:39.365685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222eebc9-c7bc-4acc-a4af-b6a4ed3a5820 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:39.394014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522d378-893b-4ca9-b565-fdceaff84fa9 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:39.436101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8296c6-f43d-4c95-acfd-9506ae0c227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:39.437100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8296c6-f43d-4c95-acfd-9506ae0c227e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.437648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8296c6-f43d-4c95-acfd-9506ae0c227e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.438123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8296c6-f43d-4c95-acfd-9506ae0c227e None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.439120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8296c6-f43d-4c95-acfd-9506ae0c227e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:39.439724 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8296c6-f43d-4c95-acfd-9506ae0c227e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:39.441522 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8296c6-f43d-4c95-acfd-9506ae0c227e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:39.455383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 311/628] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:39.456590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8296c6-f43d-4c95-acfd-9506ae0c227e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:39.474240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:39.494609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222eebc9-c7bc-4acc-a4af-b6a4ed3a5820 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:39.512320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:39.531373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c15bb-d77f-434e-869d-79e0b4278a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:39.532342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c15bb-d77f-434e-869d-79e0b4278a9e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.532848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c15bb-d77f-434e-869d-79e0b4278a9e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.533345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c15bb-d77f-434e-869d-79e0b4278a9e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.543486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c15bb-d77f-434e-869d-79e0b4278a9e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:39.545376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c15bb-d77f-434e-869d-79e0b4278a9e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-5e1c15bb-d77f-434e-869d-79e0b4278a9e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:39.559181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:39.581017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 318/629] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:39.582013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c15bb-d77f-434e-869d-79e0b4278a9e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:39.582685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8296c6-f43d-4c95-acfd-9506ae0c227e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:39.616251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6dd47-4f0f-4477-ad17-03f308dad5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:39.616908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6dd47-4f0f-4477-ad17-03f308dad5fa None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.617185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6dd47-4f0f-4477-ad17-03f308dad5fa None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.617455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6dd47-4f0f-4477-ad17-03f308dad5fa None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.618867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6dd47-4f0f-4477-ad17-03f308dad5fa None admin] RBAC: Adding query filter params (name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:39.619098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6dd47-4f0f-4477-ad17-03f308dad5fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:39.620484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6dd47-4f0f-4477-ad17-03f308dad5fa None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:39.629442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 312/630] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:39.630257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6dd47-4f0f-4477-ad17-03f308dad5fa None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:39.682224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c15bb-d77f-434e-869d-79e0b4278a9e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:39.719082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:39.723138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86aee7b-c2f5-40e8-8fb9-c3aa607c8fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:39.723821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aee7b-c2f5-40e8-8fb9-c3aa607c8fd8 None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.724103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aee7b-c2f5-40e8-8fb9-c3aa607c8fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.724380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86aee7b-c2f5-40e8-8fb9-c3aa607c8fd8 None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/92bc91b8b5224bd18f79bd8ea4663d3f/roles/3713b2e0c4f04c8cad78881a656528e6` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.741403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aee7b-c2f5-40e8-8fb9-c3aa607c8fd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=92bc91b8b5224bd18f79bd8ea4663d3f, role_id=3713b2e0c4f04c8cad78881a656528e6)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:39.742979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86aee7b-c2f5-40e8-8fb9-c3aa607c8fd8 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:39.743894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6dd47-4f0f-4477-ad17-03f308dad5fa None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:39.778373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cb0d5-9637-4a80-a806-5ea355196e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:39.779476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cb0d5-9637-4a80-a806-5ea355196e80 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.779476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cb0d5-9637-4a80-a806-5ea355196e80 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.779476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cb0d5-9637-4a80-a806-5ea355196e80 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.780278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cb0d5-9637-4a80-a806-5ea355196e80 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:39.780614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cb0d5-9637-4a80-a806-5ea355196e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:39.782041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cb0d5-9637-4a80-a806-5ea355196e80 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:39.800740 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 313/631] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 15:37:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:39.801940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3fdd4-1620-4e1a-a666-b13304464bc8 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.802220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3fdd4-1620-4e1a-a666-b13304464bc8 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.802498 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3fdd4-1620-4e1a-a666-b13304464bc8 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.803730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 314/632] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:39.804420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3fdd4-1620-4e1a-a666-b13304464bc8 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:39.869664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 319/633] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:37:39 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/92bc91b8b5224bd18f79bd8ea4663d3f/roles/3713b2e0c4f04c8cad78881a656528e6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:37:39.870917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4400d-370f-4c02-b201-e75ad7eb82a7 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.871207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4400d-370f-4c02-b201-e75ad7eb82a7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.871471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4400d-370f-4c02-b201-e75ad7eb82a7 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.873054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 320/634] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:39.873829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4400d-370f-4c02-b201-e75ad7eb82a7 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:39.912825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:39.916836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3fdd4-1620-4e1a-a666-b13304464bc8 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:39.963275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfeb62-bfbe-456c-b102-34eeb235dfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:39.963915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfeb62-bfbe-456c-b102-34eeb235dfa8 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:39.964308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfeb62-bfbe-456c-b102-34eeb235dfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:39.964683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfeb62-bfbe-456c-b102-34eeb235dfa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:39.967086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:39.977860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfeb62-bfbe-456c-b102-34eeb235dfa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:39.979385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfeb62-bfbe-456c-b102-34eeb235dfa8 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-a9dfeb62-bfbe-456c-b102-34eeb235dfa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:39.996403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:40.004166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:40.005244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:40.005244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:40.005244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:40.005244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 315/635] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:40.005244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808268-0b1c-488a-a599-91a2b1568c2e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:40.005244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808268-0b1c-488a-a599-91a2b1568c2e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:40.005244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f808268-0b1c-488a-a599-91a2b1568c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:40.027207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4400d-370f-4c02-b201-e75ad7eb82a7 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:40.029028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-5f808268-0b1c-488a-a599-91a2b1568c2e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:40.030316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5f808268-0b1c-488a-a599-91a2b1568c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:40.068848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90fa7b-f199-480e-b67a-ccf55d2c9b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:40.069743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90fa7b-f199-480e-b67a-ccf55d2c9b17 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:40.070276 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90fa7b-f199-480e-b67a-ccf55d2c9b17 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:40.070548 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90fa7b-f199-480e-b67a-ccf55d2c9b17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:40.106514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 316/636] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:40.108059 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907af386-1427-4bcd-8695-248c6d4ca8e1 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:40.108343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907af386-1427-4bcd-8695-248c6d4ca8e1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:40.108646 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907af386-1427-4bcd-8695-248c6d4ca8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:40.126675 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-907af386-1427-4bcd-8695-248c6d4ca8e1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:40.127861 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-907af386-1427-4bcd-8695-248c6d4ca8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:40.178680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90fa7b-f199-480e-b67a-ccf55d2c9b17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:40.180200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90fa7b-f199-480e-b67a-ccf55d2c9b17 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:40.213109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 317/637] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:40.214150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907af386-1427-4bcd-8695-248c6d4ca8e1 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:40.217046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:40.267426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:40.325777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 321/638] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:40.330886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907af386-1427-4bcd-8695-248c6d4ca8e1 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:40.334551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90fa7b-f199-480e-b67a-ccf55d2c9b17 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:40.370529 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981fa80-6854-4328-9b31-6c26c9d5ced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:40.371501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981fa80-6854-4328-9b31-6c26c9d5ced5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:40.372117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981fa80-6854-4328-9b31-6c26c9d5ced5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:40.372609 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981fa80-6854-4328-9b31-6c26c9d5ced5 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:40.373516 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981fa80-6854-4328-9b31-6c26c9d5ced5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:40.374012 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981fa80-6854-4328-9b31-6c26c9d5ced5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:40.375622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981fa80-6854-4328-9b31-6c26c9d5ced5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:40.389560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 318/639] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:40.395471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981fa80-6854-4328-9b31-6c26c9d5ced5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:40.457439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90fa7b-f199-480e-b67a-ccf55d2c9b17 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:40.501464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:40.518033 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981fa80-6854-4328-9b31-6c26c9d5ced5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:40.523868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522bb7-08c0-4a34-bc40-edfba4eb1814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:40.525445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522bb7-08c0-4a34-bc40-edfba4eb1814 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:40.525994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522bb7-08c0-4a34-bc40-edfba4eb1814 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:40.526110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:40.526747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522bb7-08c0-4a34-bc40-edfba4eb1814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:40.546223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17522bb7-08c0-4a34-bc40-edfba4eb1814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:40.548595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17522bb7-08c0-4a34-bc40-edfba4eb1814 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:40.557480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb58b8b-c2d2-457a-8985-11068b74e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:40.558456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb58b8b-c2d2-457a-8985-11068b74e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:40.558964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb58b8b-c2d2-457a-8985-11068b74e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:40.559450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb58b8b-c2d2-457a-8985-11068b74e4e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-17522bb7-08c0-4a34-bc40-edfba4eb1814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:40.567596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:40.568652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:40.570135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:40.570135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:40.570135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:40.570135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 322/640] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:40.570135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522bb7-08c0-4a34-bc40-edfba4eb1814 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:40.575793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb58b8b-c2d2-457a-8985-11068b74e4e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:40.577674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb58b8b-c2d2-457a-8985-11068b74e4e9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-3fb58b8b-c2d2-457a-8985-11068b74e4e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:40.591613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:40.592605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:40.593550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:40.593550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:40.593550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:40.593550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:40.593550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:40.593550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:40.593550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:40.593550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:40.593550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:37:40.593550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:40.596310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 319/641] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 15:37:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:40.597321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb58b8b-c2d2-457a-8985-11068b74e4e9 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:40.690993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522bb7-08c0-4a34-bc40-edfba4eb1814 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:40.729644 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b9db2-c1c9-408e-958c-6452d2fc12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:40.730295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b9db2-c1c9-408e-958c-6452d2fc12f5 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:40.730573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b9db2-c1c9-408e-958c-6452d2fc12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:40.730844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b9db2-c1c9-408e-958c-6452d2fc12f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:40.732098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb58b8b-c2d2-457a-8985-11068b74e4e9 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:40.741751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b9db2-c1c9-408e-958c-6452d2fc12f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-b62b9db2-c1c9-408e-958c-6452d2fc12f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:40.747395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:40.748541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 323/642] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:40.749414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b9db2-c1c9-408e-958c-6452d2fc12f5 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:40.775098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccfa1c-5e1e-4367-b31e-2deb76a19344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:40.775730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccfa1c-5e1e-4367-b31e-2deb76a19344 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:40.776094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccfa1c-5e1e-4367-b31e-2deb76a19344 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:40.776461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccfa1c-5e1e-4367-b31e-2deb76a19344 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:40.777191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccfa1c-5e1e-4367-b31e-2deb76a19344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:40.777526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccfa1c-5e1e-4367-b31e-2deb76a19344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:40.778975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ccfa1c-5e1e-4367-b31e-2deb76a19344 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:40.796421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 320/643] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:40.796421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccfa1c-5e1e-4367-b31e-2deb76a19344 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:40.796734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:40.825399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:40.869435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b9db2-c1c9-408e-958c-6452d2fc12f5 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:40.903311 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccfa1c-5e1e-4367-b31e-2deb76a19344 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:40.909523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ee2e-0451-47de-9ea1-9958bd5c918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:40.910153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ee2e-0451-47de-9ea1-9958bd5c918b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:40.910432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ee2e-0451-47de-9ea1-9958bd5c918b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:40.910713 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ee2e-0451-47de-9ea1-9958bd5c918b None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:40.911439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5ee2e-0451-47de-9ea1-9958bd5c918b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:40.911747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5ee2e-0451-47de-9ea1-9958bd5c918b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:40.913299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5ee2e-0451-47de-9ea1-9958bd5c918b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:40.941942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 324/644] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 15:37:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:40.941942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ee2e-0451-47de-9ea1-9958bd5c918b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:40.955291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b66221-50e3-49da-a3ba-0503e8974334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:40.955962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b66221-50e3-49da-a3ba-0503e8974334 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:40.956237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b66221-50e3-49da-a3ba-0503e8974334 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:40.956531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b66221-50e3-49da-a3ba-0503e8974334 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:40.975316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b66221-50e3-49da-a3ba-0503e8974334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-16b66221-50e3-49da-a3ba-0503e8974334 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:40.981058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:40.981995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:40.982988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:40.987304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 321/645] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:40.988196 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b66221-50e3-49da-a3ba-0503e8974334 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:41.051563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:41.057996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ee2e-0451-47de-9ea1-9958bd5c918b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:41.091184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:41.097964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe39807-2b4c-405f-8ca8-81ffa4d5652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:41.098583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe39807-2b4c-405f-8ca8-81ffa4d5652e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:41.098860 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe39807-2b4c-405f-8ca8-81ffa4d5652e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:41.099124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe39807-2b4c-405f-8ca8-81ffa4d5652e None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:41.099783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe39807-2b4c-405f-8ca8-81ffa4d5652e None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:41.100079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe39807-2b4c-405f-8ca8-81ffa4d5652e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:41.101553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe39807-2b4c-405f-8ca8-81ffa4d5652e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:41.108127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b66221-50e3-49da-a3ba-0503e8974334 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:41.111156 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 325/646] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:41.111375 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe39807-2b4c-405f-8ca8-81ffa4d5652e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:41.161384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f83942-2589-4c86-9c7b-4dfd40b6f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:41.162471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f83942-2589-4c86-9c7b-4dfd40b6f5ec None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:41.162929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f83942-2589-4c86-9c7b-4dfd40b6f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:41.163374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f83942-2589-4c86-9c7b-4dfd40b6f5ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:41.175545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f83942-2589-4c86-9c7b-4dfd40b6f5ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:41.178054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f83942-2589-4c86-9c7b-4dfd40b6f5ec None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-33f83942-2589-4c86-9c7b-4dfd40b6f5ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:41.199748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:41.201075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:41.202003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:41.202003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:41.202003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:41.202003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:41.202003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:41.202003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:41.202003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:41.202003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:41.202003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 322/647] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:41.203130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f83942-2589-4c86-9c7b-4dfd40b6f5ec None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:41.232951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe39807-2b4c-405f-8ca8-81ffa4d5652e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:41.280282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8762c5f-1054-4d57-845c-1aadc19f7a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:41.280917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8762c5f-1054-4d57-845c-1aadc19f7a60 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:41.281199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8762c5f-1054-4d57-845c-1aadc19f7a60 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:41.281480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8762c5f-1054-4d57-845c-1aadc19f7a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:41.312855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:41.347129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f83942-2589-4c86-9c7b-4dfd40b6f5ec None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:41.364785 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8762c5f-1054-4d57-845c-1aadc19f7a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:41.366287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8762c5f-1054-4d57-845c-1aadc19f7a60 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:41.387084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efa131-11aa-432f-b497-f79519dfc3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:41.387701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efa131-11aa-432f-b497-f79519dfc3b8 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:41.387978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efa131-11aa-432f-b497-f79519dfc3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:41.388249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efa131-11aa-432f-b497-f79519dfc3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:41.388959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efa131-11aa-432f-b497-f79519dfc3b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:41.389262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efa131-11aa-432f-b497-f79519dfc3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:41.390629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efa131-11aa-432f-b497-f79519dfc3b8 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:41.406265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 323/648] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:41.406265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efa131-11aa-432f-b497-f79519dfc3b8 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:41.418835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:41.496109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 326/649] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:41.497445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8762c5f-1054-4d57-845c-1aadc19f7a60 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:41.532287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efa131-11aa-432f-b497-f79519dfc3b8 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:41.570791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37e715-e67a-4831-9120-86997cc5cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:41.571408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37e715-e67a-4831-9120-86997cc5cd21 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:41.571679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37e715-e67a-4831-9120-86997cc5cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:41.571973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37e715-e67a-4831-9120-86997cc5cd21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:41.578777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:41.584907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37e715-e67a-4831-9120-86997cc5cd21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:41.586430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37e715-e67a-4831-9120-86997cc5cd21 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-db37e715-e67a-4831-9120-86997cc5cd21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:41.601833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:41.617519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:41.618821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:41.618821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:41.618821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:41.618821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 324/650] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:41.618821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37e715-e67a-4831-9120-86997cc5cd21 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:41.634340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8762c5f-1054-4d57-845c-1aadc19f7a60 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:41.673477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:41.678756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c7fd6-b572-44f1-993a-d2cdffd44c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:41.679382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c7fd6-b572-44f1-993a-d2cdffd44c02 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:41.679660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c7fd6-b572-44f1-993a-d2cdffd44c02 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:41.679933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c7fd6-b572-44f1-993a-d2cdffd44c02 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:41.680792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c7fd6-b572-44f1-993a-d2cdffd44c02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:41.681003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c7fd6-b572-44f1-993a-d2cdffd44c02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:41.682462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c7fd6-b572-44f1-993a-d2cdffd44c02 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:41.695829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 327/651] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:41.697240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c7fd6-b572-44f1-993a-d2cdffd44c02 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:41.727288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37e715-e67a-4831-9120-86997cc5cd21 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:41.766859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc76f4f-17d6-429d-a793-2fcb1d456948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:41.767834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc76f4f-17d6-429d-a793-2fcb1d456948 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:41.768326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc76f4f-17d6-429d-a793-2fcb1d456948 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:41.768818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc76f4f-17d6-429d-a793-2fcb1d456948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:41.783598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc76f4f-17d6-429d-a793-2fcb1d456948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:41.786786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc76f4f-17d6-429d-a793-2fcb1d456948 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-6fc76f4f-17d6-429d-a793-2fcb1d456948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:41.809035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:41.810574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:41.812384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:41.812384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:41.812384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:41.812384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 325/652] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:41.812384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc76f4f-17d6-429d-a793-2fcb1d456948 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:41.818871 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c7fd6-b572-44f1-993a-d2cdffd44c02 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:41.839272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:41.863746 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b924194-59a0-478c-9e02-4f04d2287405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:41.864505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b924194-59a0-478c-9e02-4f04d2287405 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:41.864912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b924194-59a0-478c-9e02-4f04d2287405 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:41.865350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b924194-59a0-478c-9e02-4f04d2287405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:41.878616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b924194-59a0-478c-9e02-4f04d2287405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:41.880243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b924194-59a0-478c-9e02-4f04d2287405 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-3b924194-59a0-478c-9e02-4f04d2287405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:41.896222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:41.897607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:41.898542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:41.898542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:41.898542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:41.898542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 328/653] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:41.898542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b924194-59a0-478c-9e02-4f04d2287405 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:41.930648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc76f4f-17d6-429d-a793-2fcb1d456948 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:41.944718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:41.967956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eacddd-2f0b-4504-97a9-d61b23ff0a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:41.968605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eacddd-2f0b-4504-97a9-d61b23ff0a31 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:41.968922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eacddd-2f0b-4504-97a9-d61b23ff0a31 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:41.969192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eacddd-2f0b-4504-97a9-d61b23ff0a31 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:41.969843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eacddd-2f0b-4504-97a9-d61b23ff0a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:41.970204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eacddd-2f0b-4504-97a9-d61b23ff0a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:41.971521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eacddd-2f0b-4504-97a9-d61b23ff0a31 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:41.983962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 326/654] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:41.984999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eacddd-2f0b-4504-97a9-d61b23ff0a31 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.009640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b924194-59a0-478c-9e02-4f04d2287405 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:42.046930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2f663-05c3-4b35-836e-a8da6cc18b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:42.047678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2f663-05c3-4b35-836e-a8da6cc18b99 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.048164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2f663-05c3-4b35-836e-a8da6cc18b99 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.048550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2f663-05c3-4b35-836e-a8da6cc18b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.049735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2f663-05c3-4b35-836e-a8da6cc18b99 None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=d8d073f3152f4825becf78c24539477e) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:42.050106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2f663-05c3-4b35-836e-a8da6cc18b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:42.052024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2f663-05c3-4b35-836e-a8da6cc18b99 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:42.068732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 329/655] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:41 2022] GET /identity/v3/role_assignments?user.id=d8d073f3152f4825becf78c24539477e&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:42.068732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326737e5-302c-43df-9655-aa875a2922e0 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.068732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326737e5-302c-43df-9655-aa875a2922e0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.068732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326737e5-302c-43df-9655-aa875a2922e0 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.068732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 330/656] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:42.068732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326737e5-302c-43df-9655-aa875a2922e0 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.099515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eacddd-2f0b-4504-97a9-d61b23ff0a31 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:42.114500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:42.143169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003db45-2891-4ccc-933d-384680bf9c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:42.143978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003db45-2891-4ccc-933d-384680bf9c9a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.144291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003db45-2891-4ccc-933d-384680bf9c9a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.144657 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003db45-2891-4ccc-933d-384680bf9c9a None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.145492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003db45-2891-4ccc-933d-384680bf9c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:42.146034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003db45-2891-4ccc-933d-384680bf9c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:42.148058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003db45-2891-4ccc-933d-384680bf9c9a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:42.168684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 327/657] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:42.168684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003db45-2891-4ccc-933d-384680bf9c9a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.203208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326737e5-302c-43df-9655-aa875a2922e0 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:42.203953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:42.250598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79113400-5e84-4536-bc00-f5ace9ebb375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:42.251222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113400-5e84-4536-bc00-f5ace9ebb375 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.251573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113400-5e84-4536-bc00-f5ace9ebb375 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.251852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79113400-5e84-4536-bc00-f5ace9ebb375 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.254657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79113400-5e84-4536-bc00-f5ace9ebb375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:42.254657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79113400-5e84-4536-bc00-f5ace9ebb375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:42.254657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79113400-5e84-4536-bc00-f5ace9ebb375 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:42.269074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 331/658] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:42.270698 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5c4a-2a77-4d6a-ae1f-0c8d0b82d58a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.271023 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5c4a-2a77-4d6a-ae1f-0c8d0b82d58a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.271425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d5c4a-2a77-4d6a-ae1f-0c8d0b82d58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.286859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003db45-2891-4ccc-933d-384680bf9c9a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:42.296492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b83d5c4a-2a77-4d6a-ae1f-0c8d0b82d58a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:42.298043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b83d5c4a-2a77-4d6a-ae1f-0c8d0b82d58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:42.328715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c78800-4293-4b30-82cf-64e9dd7963e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:42.329549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c78800-4293-4b30-82cf-64e9dd7963e0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.329958 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c78800-4293-4b30-82cf-64e9dd7963e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.330335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c78800-4293-4b30-82cf-64e9dd7963e0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.340062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c78800-4293-4b30-82cf-64e9dd7963e0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:42.341544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c78800-4293-4b30-82cf-64e9dd7963e0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-f7c78800-4293-4b30-82cf-64e9dd7963e0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:42.355921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:42.357383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 328/659] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:42.358869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c78800-4293-4b30-82cf-64e9dd7963e0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.392556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 332/660] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:42.392556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d5c4a-2a77-4d6a-ae1f-0c8d0b82d58a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.423695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:42.481725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:42.491213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c78800-4293-4b30-82cf-64e9dd7963e0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:42.532955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d5c4a-2a77-4d6a-ae1f-0c8d0b82d58a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:42.537671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e98553-9ce4-4dcf-b731-5f7525d49813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:42.538392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e98553-9ce4-4dcf-b731-5f7525d49813 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.538742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e98553-9ce4-4dcf-b731-5f7525d49813 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.539085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e98553-9ce4-4dcf-b731-5f7525d49813 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.551147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e98553-9ce4-4dcf-b731-5f7525d49813 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:42.553511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e98553-9ce4-4dcf-b731-5f7525d49813 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-c3e98553-9ce4-4dcf-b731-5f7525d49813 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:42.568775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:42.569778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 329/661] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:42.571554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e98553-9ce4-4dcf-b731-5f7525d49813 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.573019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a46ea-c4cc-4483-82a1-144a017d6eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:42.576547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a46ea-c4cc-4483-82a1-144a017d6eee None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.576547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a46ea-c4cc-4483-82a1-144a017d6eee None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.576547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a46ea-c4cc-4483-82a1-144a017d6eee None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.581174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a46ea-c4cc-4483-82a1-144a017d6eee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:42.582630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a46ea-c4cc-4483-82a1-144a017d6eee None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-ee9a46ea-c4cc-4483-82a1-144a017d6eee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:42.594279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:42.596352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:42.598562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:42.598562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:42.598562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:42.598562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:42.598562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:42.598562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:42.598562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:42.598562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:42.604645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 333/662] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:42.604645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a46ea-c4cc-4483-82a1-144a017d6eee None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.688952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e98553-9ce4-4dcf-b731-5f7525d49813 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:42.691919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:42.708720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a46ea-c4cc-4483-82a1-144a017d6eee None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:42.725692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143aa16-673d-45a1-9654-4cf56e8df775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:42.726306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143aa16-673d-45a1-9654-4cf56e8df775 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.726586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143aa16-673d-45a1-9654-4cf56e8df775 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.726851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143aa16-673d-45a1-9654-4cf56e8df775 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.728129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143aa16-673d-45a1-9654-4cf56e8df775 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:42.728440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143aa16-673d-45a1-9654-4cf56e8df775 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:42.729897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143aa16-673d-45a1-9654-4cf56e8df775 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:42.753589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 330/663] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Aug 22 15:37:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:42.754067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071520-5326-40bd-a7b1-0287752f6d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:42.754067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071520-5326-40bd-a7b1-0287752f6d8e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.754244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143aa16-673d-45a1-9654-4cf56e8df775 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.754317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071520-5326-40bd-a7b1-0287752f6d8e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.754317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae071520-5326-40bd-a7b1-0287752f6d8e None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.754317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071520-5326-40bd-a7b1-0287752f6d8e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:42.754317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071520-5326-40bd-a7b1-0287752f6d8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:42.754317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae071520-5326-40bd-a7b1-0287752f6d8e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:42.769182 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:42.784564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 334/664] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 15:37:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:42.784564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071520-5326-40bd-a7b1-0287752f6d8e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.870294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143aa16-673d-45a1-9654-4cf56e8df775 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:42.897368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae071520-5326-40bd-a7b1-0287752f6d8e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:42.907651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5813-7eba-483f-aab5-7820309cb84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:42.908364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5813-7eba-483f-aab5-7820309cb84c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.908757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5813-7eba-483f-aab5-7820309cb84c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.909030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5813-7eba-483f-aab5-7820309cb84c None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.909729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae5813-7eba-483f-aab5-7820309cb84c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:42.910035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae5813-7eba-483f-aab5-7820309cb84c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:42.911461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae5813-7eba-483f-aab5-7820309cb84c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:42.925809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 331/665] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:42.927015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5813-7eba-483f-aab5-7820309cb84c None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.941743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0190009-01fa-4e9e-99a4-cdea621b323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:42.942561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0190009-01fa-4e9e-99a4-cdea621b323c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:42.942561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0190009-01fa-4e9e-99a4-cdea621b323c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:42.942823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0190009-01fa-4e9e-99a4-cdea621b323c None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:42.953967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0190009-01fa-4e9e-99a4-cdea621b323c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-d0190009-01fa-4e9e-99a4-cdea621b323c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:42.958680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:42.959774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 335/666] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:42.965756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0190009-01fa-4e9e-99a4-cdea621b323c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:42.971572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:43.014210 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:43.047518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5813-7eba-483f-aab5-7820309cb84c None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:43.078265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0190009-01fa-4e9e-99a4-cdea621b323c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:43.082636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8463-06d5-47cf-9c71-51e592abd381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:43.083297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8463-06d5-47cf-9c71-51e592abd381 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:43.083619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8463-06d5-47cf-9c71-51e592abd381 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:43.083944 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c8463-06d5-47cf-9c71-51e592abd381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:43.116034 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9420e66-bbf9-4a19-9c23-60ee3783033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:43.116699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9420e66-bbf9-4a19-9c23-60ee3783033a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:43.116968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9420e66-bbf9-4a19-9c23-60ee3783033a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:43.117239 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9420e66-bbf9-4a19-9c23-60ee3783033a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:43.158736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8463-06d5-47cf-9c71-51e592abd381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:43.160235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c8463-06d5-47cf-9c71-51e592abd381 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:43.189598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9420e66-bbf9-4a19-9c23-60ee3783033a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:43.191215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9420e66-bbf9-4a19-9c23-60ee3783033a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:43.223582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:43.266978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 332/667] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:43.268159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8463-06d5-47cf-9c71-51e592abd381 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:43.276489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:43.309515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 336/668] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:43.310497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9420e66-bbf9-4a19-9c23-60ee3783033a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:43.378813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c8463-06d5-47cf-9c71-51e592abd381 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:43.416751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72310a46-839f-4fe9-9d9f-e0a960d1a61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:43.417471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72310a46-839f-4fe9-9d9f-e0a960d1a61a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:43.417747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72310a46-839f-4fe9-9d9f-e0a960d1a61a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:43.418015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72310a46-839f-4fe9-9d9f-e0a960d1a61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:43.418119 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9420e66-bbf9-4a19-9c23-60ee3783033a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:43.418735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72310a46-839f-4fe9-9d9f-e0a960d1a61a None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=1c12495a6cf64c80b45785f185f28383) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:43.419041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72310a46-839f-4fe9-9d9f-e0a960d1a61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:43.419588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:43.420534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72310a46-839f-4fe9-9d9f-e0a960d1a61a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:43.426624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 333/669] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:43 2022] GET /identity/v3/role_assignments?user.id=1c12495a6cf64c80b45785f185f28383&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:43.427414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72310a46-839f-4fe9-9d9f-e0a960d1a61a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:43.472495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:43.474872 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4359d16-2ba2-469b-a39b-bb681d8dafb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:43.475764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4359d16-2ba2-469b-a39b-bb681d8dafb6 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:43.476318 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4359d16-2ba2-469b-a39b-bb681d8dafb6 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:43.476888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4359d16-2ba2-469b-a39b-bb681d8dafb6 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:43.477803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4359d16-2ba2-469b-a39b-bb681d8dafb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:43.478299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4359d16-2ba2-469b-a39b-bb681d8dafb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:43.479946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4359d16-2ba2-469b-a39b-bb681d8dafb6 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:43.495861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 337/670] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:43.495861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4359d16-2ba2-469b-a39b-bb681d8dafb6 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:43.558704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72310a46-839f-4fe9-9d9f-e0a960d1a61a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:43.606755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a843d02-5fc0-4ae8-a0c6-5b44ba80b8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:43.607871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a843d02-5fc0-4ae8-a0c6-5b44ba80b8e6 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:43.608874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a843d02-5fc0-4ae8-a0c6-5b44ba80b8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:43.609856 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a843d02-5fc0-4ae8-a0c6-5b44ba80b8e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:43.624882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a843d02-5fc0-4ae8-a0c6-5b44ba80b8e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:43.627148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a843d02-5fc0-4ae8-a0c6-5b44ba80b8e6 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:43.641856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4359d16-2ba2-469b-a39b-bb681d8dafb6 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-4a843d02-5fc0-4ae8-a0c6-5b44ba80b8e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:43.643895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:43.645118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:43.646054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:43.646054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:43.646054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:43.648047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 334/671] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:43.649174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a843d02-5fc0-4ae8-a0c6-5b44ba80b8e6 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:43.693208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2631f33-c8a0-4b0d-a5f3-0e732f31d827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:43.697090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631f33-c8a0-4b0d-a5f3-0e732f31d827 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:43.697090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631f33-c8a0-4b0d-a5f3-0e732f31d827 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:43.697090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2631f33-c8a0-4b0d-a5f3-0e732f31d827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:43.714156 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2631f33-c8a0-4b0d-a5f3-0e732f31d827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:43.716343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2631f33-c8a0-4b0d-a5f3-0e732f31d827 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-b2631f33-c8a0-4b0d-a5f3-0e732f31d827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:43.735602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:43.736819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:43.737966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:43.737966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:43.737966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:43.737966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 338/672] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:43.738374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2631f33-c8a0-4b0d-a5f3-0e732f31d827 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:43.770986 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:43.771211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:43.786841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a843d02-5fc0-4ae8-a0c6-5b44ba80b8e6 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:43.833360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce1c18-dd2d-4d4e-849a-00feec868dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:43.833999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1c18-dd2d-4d4e-849a-00feec868dad None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:43.834277 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1c18-dd2d-4d4e-849a-00feec868dad None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:43.834551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce1c18-dd2d-4d4e-849a-00feec868dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:43.847000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce1c18-dd2d-4d4e-849a-00feec868dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:43.848461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce1c18-dd2d-4d4e-849a-00feec868dad None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-fcce1c18-dd2d-4d4e-849a-00feec868dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:43.863966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:43.865021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:43.865956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:43.865956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:43.865956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:43.865956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 335/673] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:43.866636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce1c18-dd2d-4d4e-849a-00feec868dad None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:43.890047 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2631f33-c8a0-4b0d-a5f3-0e732f31d827 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:43.947055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc2bc-6341-4e7e-b890-845c5bb897d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:43.947775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc2bc-6341-4e7e-b890-845c5bb897d0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:43.948059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc2bc-6341-4e7e-b890-845c5bb897d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:43.948329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc2bc-6341-4e7e-b890-845c5bb897d0 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:43.949010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc2bc-6341-4e7e-b890-845c5bb897d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:43.949739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc2bc-6341-4e7e-b890-845c5bb897d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:43.951881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc2bc-6341-4e7e-b890-845c5bb897d0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:43.972576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 339/674] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:43.973682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc2bc-6341-4e7e-b890-845c5bb897d0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:43.996994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce1c18-dd2d-4d4e-849a-00feec868dad None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.039089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bd25e-8e5b-4b83-836a-924874da9840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:44.040267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bd25e-8e5b-4b83-836a-924874da9840 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.040485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bd25e-8e5b-4b83-836a-924874da9840 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.040801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bd25e-8e5b-4b83-836a-924874da9840 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.041668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bd25e-8e5b-4b83-836a-924874da9840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:44.041792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bd25e-8e5b-4b83-836a-924874da9840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:44.043226 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bd25e-8e5b-4b83-836a-924874da9840 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:44.052179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:44.058070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 336/675] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:44.058719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bd25e-8e5b-4b83-836a-924874da9840 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:44.086216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:44.110619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc2bc-6341-4e7e-b890-845c5bb897d0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.148560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2fc33-f63c-42fc-ac11-1b5cef20a9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:44.149214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2fc33-f63c-42fc-ac11-1b5cef20a9ad None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.149496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2fc33-f63c-42fc-ac11-1b5cef20a9ad None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.149769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2fc33-f63c-42fc-ac11-1b5cef20a9ad None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.150417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2fc33-f63c-42fc-ac11-1b5cef20a9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:44.150718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2fc33-f63c-42fc-ac11-1b5cef20a9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:44.152102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2fc33-f63c-42fc-ac11-1b5cef20a9ad None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:44.165357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 340/676] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:44.167162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53510-1550-485c-ae0e-328e51aaa623 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.167728 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53510-1550-485c-ae0e-328e51aaa623 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.168208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f53510-1550-485c-ae0e-328e51aaa623 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.174239 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 341/677] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:44.174620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bd25e-8e5b-4b83-836a-924874da9840 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.175347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f53510-1550-485c-ae0e-328e51aaa623 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:44.215660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7e526-a98e-413e-b5d6-e38cf8034d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:44.216370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7e526-a98e-413e-b5d6-e38cf8034d28 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.216677 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7e526-a98e-413e-b5d6-e38cf8034d28 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.216982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7e526-a98e-413e-b5d6-e38cf8034d28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.224246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7e526-a98e-413e-b5d6-e38cf8034d28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:44.225817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7e526-a98e-413e-b5d6-e38cf8034d28 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-dee7e526-a98e-413e-b5d6-e38cf8034d28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:44.238639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:44.239599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:44.240507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:44.240507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:44.240507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:44.240507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:44.240507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:44.240507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:44.240507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:44.240507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:44.240507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 337/678] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:44.241075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7e526-a98e-413e-b5d6-e38cf8034d28 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:44.298432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f53510-1550-485c-ae0e-328e51aaa623 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.309136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:44.336147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615edb2-9213-4eb4-91df-88e258560bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:44.337385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615edb2-9213-4eb4-91df-88e258560bdf None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.337594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615edb2-9213-4eb4-91df-88e258560bdf None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.337862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615edb2-9213-4eb4-91df-88e258560bdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.340566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:44.346362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615edb2-9213-4eb4-91df-88e258560bdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:44.347904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615edb2-9213-4eb4-91df-88e258560bdf None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:44.355291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7e526-a98e-413e-b5d6-e38cf8034d28 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-6615edb2-9213-4eb4-91df-88e258560bdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:44.360011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:44.367558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 342/679] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8702a0-048f-45ab-9b72-7e7c9d9a9fec None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.368820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8702a0-048f-45ab-9b72-7e7c9d9a9fec None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.369590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8702a0-048f-45ab-9b72-7e7c9d9a9fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.381378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-fa8702a0-048f-45ab-9b72-7e7c9d9a9fec None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:44.382936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fa8702a0-048f-45ab-9b72-7e7c9d9a9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:44.398031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205c390-9621-4531-a3df-6ed72de7ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:44.398692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205c390-9621-4531-a3df-6ed72de7ead4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.399744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205c390-9621-4531-a3df-6ed72de7ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.399744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205c390-9621-4531-a3df-6ed72de7ead4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.409172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205c390-9621-4531-a3df-6ed72de7ead4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:44.410620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205c390-9621-4531-a3df-6ed72de7ead4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-a205c390-9621-4531-a3df-6ed72de7ead4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:44.422845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:44.424080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 338/680] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:44.425519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205c390-9621-4531-a3df-6ed72de7ead4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:44.459060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 343/681] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:44.460331 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8702a0-048f-45ab-9b72-7e7c9d9a9fec None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:44.562820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205c390-9621-4531-a3df-6ed72de7ead4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.575112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8702a0-048f-45ab-9b72-7e7c9d9a9fec None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.587625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:44.605412 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:44.613041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053dade-bd91-4ca0-80b1-1e6e9628dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:44.613896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dade-bd91-4ca0-80b1-1e6e9628dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.614209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14845d14-de48-43f5-b2c1-5ccfa3a95fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:44.614536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dade-bd91-4ca0-80b1-1e6e9628dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.614824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14845d14-de48-43f5-b2c1-5ccfa3a95fbd None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.615112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14845d14-de48-43f5-b2c1-5ccfa3a95fbd None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.615254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dade-bd91-4ca0-80b1-1e6e9628dcc9 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.615382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14845d14-de48-43f5-b2c1-5ccfa3a95fbd None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.616081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14845d14-de48-43f5-b2c1-5ccfa3a95fbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:44.616365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053dade-bd91-4ca0-80b1-1e6e9628dcc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:44.616494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14845d14-de48-43f5-b2c1-5ccfa3a95fbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:44.617008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053dade-bd91-4ca0-80b1-1e6e9628dcc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:44.617913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14845d14-de48-43f5-b2c1-5ccfa3a95fbd None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:44.618812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053dade-bd91-4ca0-80b1-1e6e9628dcc9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:44.634296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 339/682] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:44.635466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053dade-bd91-4ca0-80b1-1e6e9628dcc9 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:44.635999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 344/683] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:44.636948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14845d14-de48-43f5-b2c1-5ccfa3a95fbd None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:44.751885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053dade-bd91-4ca0-80b1-1e6e9628dcc9 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.754238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14845d14-de48-43f5-b2c1-5ccfa3a95fbd None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.790640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d7e51-5ead-4f0b-afd1-cd8ca4c003ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:44.791255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7e51-5ead-4f0b-afd1-cd8ca4c003ab None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.791538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7e51-5ead-4f0b-afd1-cd8ca4c003ab None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.791811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d7e51-5ead-4f0b-afd1-cd8ca4c003ab None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.792439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd219054-cdd8-4032-ab92-8a924a1eccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:44.792591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d7e51-5ead-4f0b-afd1-cd8ca4c003ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:44.792874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d7e51-5ead-4f0b-afd1-cd8ca4c003ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:44.793086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd219054-cdd8-4032-ab92-8a924a1eccde None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.793371 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd219054-cdd8-4032-ab92-8a924a1eccde None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.793648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd219054-cdd8-4032-ab92-8a924a1eccde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.794423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d7e51-5ead-4f0b-afd1-cd8ca4c003ab None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:44.794547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd219054-cdd8-4032-ab92-8a924a1eccde None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=c2de83ba29194578a9a229d5bab6612e) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:44.794735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd219054-cdd8-4032-ab92-8a924a1eccde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:44.796189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd219054-cdd8-4032-ab92-8a924a1eccde None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:44.804579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 345/684] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:44 2022] GET /identity/v3/role_assignments?user.id=c2de83ba29194578a9a229d5bab6612e&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:44.804579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd219054-cdd8-4032-ab92-8a924a1eccde None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:44.827772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 340/685] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 15:37:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:44.833653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d7e51-5ead-4f0b-afd1-cd8ca4c003ab None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:44.870310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:44.884909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:44.929950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd219054-cdd8-4032-ab92-8a924a1eccde None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.949361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d7e51-5ead-4f0b-afd1-cd8ca4c003ab None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:44.984980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f033d78-f80b-47c4-9fcf-90737e38af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:44.985625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f033d78-f80b-47c4-9fcf-90737e38af15 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:44.985909 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f033d78-f80b-47c4-9fcf-90737e38af15 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:44.986183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f033d78-f80b-47c4-9fcf-90737e38af15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:44.986916 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f033d78-f80b-47c4-9fcf-90737e38af15 None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=90324fa56d0743699f2fddd17fb630dd) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:44.987266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f033d78-f80b-47c4-9fcf-90737e38af15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:44.988791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f033d78-f80b-47c4-9fcf-90737e38af15 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:44.998709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 346/686] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:44 2022] GET /identity/v3/role_assignments?user.id=90324fa56d0743699f2fddd17fb630dd&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:44.999892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f033d78-f80b-47c4-9fcf-90737e38af15 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:45.030123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d61768-1dd1-4536-b93f-6de0b6592bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:45.030827 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d61768-1dd1-4536-b93f-6de0b6592bc1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:45.031070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d61768-1dd1-4536-b93f-6de0b6592bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:45.031345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d61768-1dd1-4536-b93f-6de0b6592bc1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:45.031977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d61768-1dd1-4536-b93f-6de0b6592bc1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:45.033395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d61768-1dd1-4536-b93f-6de0b6592bc1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-44d61768-1dd1-4536-b93f-6de0b6592bc1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:45.062939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:45.064688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:45.065643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 341/687] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Aug 22 15:37:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:45.073939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d61768-1dd1-4536-b93f-6de0b6592bc1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:45.138040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f033d78-f80b-47c4-9fcf-90737e38af15 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:45.155265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:45.178481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fde95-a38b-48f9-b349-0a0ce29097a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:45.179413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fde95-a38b-48f9-b349-0a0ce29097a2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:45.179849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fde95-a38b-48f9-b349-0a0ce29097a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:45.180318 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fde95-a38b-48f9-b349-0a0ce29097a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:45.196099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:45.199638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d61768-1dd1-4536-b93f-6de0b6592bc1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:45.236274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cd879-7ef9-4f7c-9900-60518a301fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:45.237067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cd879-7ef9-4f7c-9900-60518a301fad None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:45.237441 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cd879-7ef9-4f7c-9900-60518a301fad None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:45.237869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cd879-7ef9-4f7c-9900-60518a301fad None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:45.238597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cd879-7ef9-4f7c-9900-60518a301fad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:45.239061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cd879-7ef9-4f7c-9900-60518a301fad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:45.240539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cd879-7ef9-4f7c-9900-60518a301fad None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:45.246044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 342/688] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 15:37:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:45.252695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cd879-7ef9-4f7c-9900-60518a301fad None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:45.258096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fde95-a38b-48f9-b349-0a0ce29097a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:45.259878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fde95-a38b-48f9-b349-0a0ce29097a2 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:45.368276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cd879-7ef9-4f7c-9900-60518a301fad None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:45.371550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 347/689] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:45.376951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fde95-a38b-48f9-b349-0a0ce29097a2 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:45.393745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:45.407359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a70d36-57e1-4a75-848d-04998ad6a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:45.408266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a70d36-57e1-4a75-848d-04998ad6a952 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:45.408539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a70d36-57e1-4a75-848d-04998ad6a952 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:45.408963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a70d36-57e1-4a75-848d-04998ad6a952 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:45.409780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a70d36-57e1-4a75-848d-04998ad6a952 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:45.410119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a70d36-57e1-4a75-848d-04998ad6a952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:45.411643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a70d36-57e1-4a75-848d-04998ad6a952 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:45.420117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 343/690] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 15:37:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:45.503183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fde95-a38b-48f9-b349-0a0ce29097a2 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:45.567287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01b89f-a3d4-4bc1-bcff-06f3e881b4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:45.567937 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01b89f-a3d4-4bc1-bcff-06f3e881b4e3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:45.568211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01b89f-a3d4-4bc1-bcff-06f3e881b4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:45.568478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01b89f-a3d4-4bc1-bcff-06f3e881b4e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:45.581367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01b89f-a3d4-4bc1-bcff-06f3e881b4e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:45.582894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01b89f-a3d4-4bc1-bcff-06f3e881b4e3 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-df01b89f-a3d4-4bc1-bcff-06f3e881b4e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:45.600092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:45.601279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:45.602705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:45.602705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:45.602705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:45.602705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 348/691] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:45.609728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a70d36-57e1-4a75-848d-04998ad6a952 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:45.645411 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:45.689775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b40ce-390b-4c86-b7b6-f05ad951412b None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:45.690090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b40ce-390b-4c86-b7b6-f05ad951412b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:45.690317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b40ce-390b-4c86-b7b6-f05ad951412b None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:45.691953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 349/692] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:45.697231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c344e4-6a0f-4601-9de5-ede85c48c6e5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:45.697511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c344e4-6a0f-4601-9de5-ede85c48c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:45.697776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c344e4-6a0f-4601-9de5-ede85c48c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:45.719642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-73c344e4-6a0f-4601-9de5-ede85c48c6e5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:45.720914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-73c344e4-6a0f-4601-9de5-ede85c48c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:45.735098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a70d36-57e1-4a75-848d-04998ad6a952 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:45.780549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6fc41-71f5-4246-bcd9-c5ec7a8e8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:45.780549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6fc41-71f5-4246-bcd9-c5ec7a8e8551 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:45.780549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6fc41-71f5-4246-bcd9-c5ec7a8e8551 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:45.780549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6fc41-71f5-4246-bcd9-c5ec7a8e8551 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:45.781071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6fc41-71f5-4246-bcd9-c5ec7a8e8551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:45.781071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6fc41-71f5-4246-bcd9-c5ec7a8e8551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:45.781451 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6fc41-71f5-4246-bcd9-c5ec7a8e8551 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:45.800506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 344/693] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:45.806338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6fc41-71f5-4246-bcd9-c5ec7a8e8551 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:45.824102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:45.832934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 350/694] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:45.940745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:45.957483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6fc41-71f5-4246-bcd9-c5ec7a8e8551 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:46.004545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa3c80-c64f-442a-a3b5-93adbf7b7454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:46.005240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa3c80-c64f-442a-a3b5-93adbf7b7454 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:46.005555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa3c80-c64f-442a-a3b5-93adbf7b7454 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:46.005831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa3c80-c64f-442a-a3b5-93adbf7b7454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:46.013469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa3c80-c64f-442a-a3b5-93adbf7b7454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:46.015038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa3c80-c64f-442a-a3b5-93adbf7b7454 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-e8aa3c80-c64f-442a-a3b5-93adbf7b7454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:46.027544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:46.028505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:46.029745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:46.029745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:46.029745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:46.029745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:46.029745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:46.029745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:46.029745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:46.029745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:46.029745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 345/695] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:46.037708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c344e4-6a0f-4601-9de5-ede85c48c6e5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:46.176781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c344e4-6a0f-4601-9de5-ede85c48c6e5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:46.226027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554023-a522-48fe-ab79-67d133515e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:46.226648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554023-a522-48fe-ab79-67d133515e1d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:46.226947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554023-a522-48fe-ab79-67d133515e1d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:46.227221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554023-a522-48fe-ab79-67d133515e1d None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:46.227914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14554023-a522-48fe-ab79-67d133515e1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:46.228305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14554023-a522-48fe-ab79-67d133515e1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:46.229869 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14554023-a522-48fe-ab79-67d133515e1d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:46.236380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa3c80-c64f-442a-a3b5-93adbf7b7454 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:46.247644 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 351/696] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:46.261802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554023-a522-48fe-ab79-67d133515e1d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:46.327282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:46.379935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554023-a522-48fe-ab79-67d133515e1d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:46.432815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb372-12f4-40fd-9b42-d968038a6ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:46.433535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb372-12f4-40fd-9b42-d968038a6ff4 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:46.433992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb372-12f4-40fd-9b42-d968038a6ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:46.434265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb372-12f4-40fd-9b42-d968038a6ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:46.434998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fb372-12f4-40fd-9b42-d968038a6ff4 None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=92bc91b8b5224bd18f79bd8ea4663d3f) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:46.435305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fb372-12f4-40fd-9b42-d968038a6ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:46.436781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fb372-12f4-40fd-9b42-d968038a6ff4 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:46.436979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa3c80-c64f-442a-a3b5-93adbf7b7454 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:46.454079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 352/697] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:46 2022] GET /identity/v3/role_assignments?user.id=92bc91b8b5224bd18f79bd8ea4663d3f&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:46.493667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352463b1-bd74-4535-8d5d-2498c97c325b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:46.494308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352463b1-bd74-4535-8d5d-2498c97c325b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:46.494589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352463b1-bd74-4535-8d5d-2498c97c325b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:46.494863 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352463b1-bd74-4535-8d5d-2498c97c325b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:46.506248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352463b1-bd74-4535-8d5d-2498c97c325b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-352463b1-bd74-4535-8d5d-2498c97c325b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:46.511298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:46.513568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:46.515581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 346/698] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:46.520550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb372-12f4-40fd-9b42-d968038a6ff4 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:46.688831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb372-12f4-40fd-9b42-d968038a6ff4 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:46.710505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:46.725050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d68b3d-185b-485a-9595-37e371fe7d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:46.725712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68b3d-185b-485a-9595-37e371fe7d04 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:46.725994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68b3d-185b-485a-9595-37e371fe7d04 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:46.726266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68b3d-185b-485a-9595-37e371fe7d04 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:46.727037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d68b3d-185b-485a-9595-37e371fe7d04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:46.727343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d68b3d-185b-485a-9595-37e371fe7d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:46.728755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d68b3d-185b-485a-9595-37e371fe7d04 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:46.738352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 353/699] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:46.745777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352463b1-bd74-4535-8d5d-2498c97c325b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:46.761722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:46.868362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352463b1-bd74-4535-8d5d-2498c97c325b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:46.904279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24405a6-93a2-4ad5-b2c5-d5c371abdca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:46.904954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24405a6-93a2-4ad5-b2c5-d5c371abdca5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:46.905235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24405a6-93a2-4ad5-b2c5-d5c371abdca5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:46.905510 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24405a6-93a2-4ad5-b2c5-d5c371abdca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:46.916962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24405a6-93a2-4ad5-b2c5-d5c371abdca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:46.918430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24405a6-93a2-4ad5-b2c5-d5c371abdca5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-f24405a6-93a2-4ad5-b2c5-d5c371abdca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:46.935183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:46.936229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:46.937176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:46.937176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:46.937176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:46.937176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 347/700] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:46.944367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d68b3d-185b-485a-9595-37e371fe7d04 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:47.066876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d68b3d-185b-485a-9595-37e371fe7d04 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:47.107253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e8aaa-97b2-4490-a6a2-5027380d242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:47.107932 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e8aaa-97b2-4490-a6a2-5027380d242b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:47.108219 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e8aaa-97b2-4490-a6a2-5027380d242b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:47.108492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e8aaa-97b2-4490-a6a2-5027380d242b None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:47.109194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e8aaa-97b2-4490-a6a2-5027380d242b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:47.109502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e8aaa-97b2-4490-a6a2-5027380d242b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:47.111013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e8aaa-97b2-4490-a6a2-5027380d242b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:47.126528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 354/701] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:47.132983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24405a6-93a2-4ad5-b2c5-d5c371abdca5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:47.204904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:47.248149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24405a6-93a2-4ad5-b2c5-d5c371abdca5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:47.284954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878872b-74d0-4121-b0f3-e259737f0f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:47.285596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878872b-74d0-4121-b0f3-e259737f0f7f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:47.285879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878872b-74d0-4121-b0f3-e259737f0f7f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:47.286152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878872b-74d0-4121-b0f3-e259737f0f7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:47.295318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878872b-74d0-4121-b0f3-e259737f0f7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:47.296801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878872b-74d0-4121-b0f3-e259737f0f7f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9878872b-74d0-4121-b0f3-e259737f0f7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:47.309602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:47.312487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:47.313613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 348/702] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 15:37:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:47.319660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e8aaa-97b2-4490-a6a2-5027380d242b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:47.387570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:47.418927 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd18e23-8e81-4561-baf4-6a94a7e2268d None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:47.419586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd18e23-8e81-4561-baf4-6a94a7e2268d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:47.420084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd18e23-8e81-4561-baf4-6a94a7e2268d None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:47.423095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 349/703] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:37:47.428236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed11f3f-8ca4-4567-b4e8-35b54479bf22 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:47.428816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed11f3f-8ca4-4567-b4e8-35b54479bf22 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:47.429328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed11f3f-8ca4-4567-b4e8-35b54479bf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:47.452183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8ed11f3f-8ca4-4567-b4e8-35b54479bf22 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:47.455532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8ed11f3f-8ca4-4567-b4e8-35b54479bf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:47.487681 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e8aaa-97b2-4490-a6a2-5027380d242b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:47.543486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67fb7c-ff83-456a-850c-bddf719201a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:47.545418 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67fb7c-ff83-456a-850c-bddf719201a1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:47.545915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67fb7c-ff83-456a-850c-bddf719201a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:47.546392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67fb7c-ff83-456a-850c-bddf719201a1 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:47.547410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67fb7c-ff83-456a-850c-bddf719201a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:47.547969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67fb7c-ff83-456a-850c-bddf719201a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:47.550496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67fb7c-ff83-456a-850c-bddf719201a1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:47.575108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 355/704] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 15:37:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:47.577586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefacb4-d2ab-4b77-9945-b8ee7b70c5df None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:47.578107 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefacb4-d2ab-4b77-9945-b8ee7b70c5df None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:47.578597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefacb4-d2ab-4b77-9945-b8ee7b70c5df None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:47.580550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 356/705] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:47.581524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefacb4-d2ab-4b77-9945-b8ee7b70c5df None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:47.607119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 350/706] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:47.607119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b83b2-0799-4fb5-9821-a35158578876 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:47.607119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b83b2-0799-4fb5-9821-a35158578876 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:47.607119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b83b2-0799-4fb5-9821-a35158578876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:47.624799 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-636b83b2-0799-4fb5-9821-a35158578876 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:47.626003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-636b83b2-0799-4fb5-9821-a35158578876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:47.707449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:47.750149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 351/707] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:47.753623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:47.759061 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefacb4-d2ab-4b77-9945-b8ee7b70c5df None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:47.798044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ded2-3dc6-4fce-bce1-ecb806a81ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:47.799457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ded2-3dc6-4fce-bce1-ecb806a81ce9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:47.800036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ded2-3dc6-4fce-bce1-ecb806a81ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:47.800565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ded2-3dc6-4fce-bce1-ecb806a81ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:47.884316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063ded2-3dc6-4fce-bce1-ecb806a81ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:47.890031 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063ded2-3dc6-4fce-bce1-ecb806a81ce9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:47.938749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b83b2-0799-4fb5-9821-a35158578876 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:48.009746 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:48.015026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 357/708] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:48.016395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1f14-a1a6-4b88-a05f-0231e60217d3 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:48.020878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1f14-a1a6-4b88-a05f-0231e60217d3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:48.021361 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae1f14-a1a6-4b88-a05f-0231e60217d3 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:48.023569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 358/709] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:48.025869 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1f14-a1a6-4b88-a05f-0231e60217d3 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:48.130414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b83b2-0799-4fb5-9821-a35158578876 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:48.196774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae1f14-a1a6-4b88-a05f-0231e60217d3 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:48.204017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a1b0e-0ea4-467b-9b32-7a57968a0de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:48.205016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1b0e-0ea4-467b-9b32-7a57968a0de8 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:48.205442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1b0e-0ea4-467b-9b32-7a57968a0de8 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:48.205881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a1b0e-0ea4-467b-9b32-7a57968a0de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:48.222715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a1b0e-0ea4-467b-9b32-7a57968a0de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:48.225815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a1b0e-0ea4-467b-9b32-7a57968a0de8 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:48.247140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd7b81-247a-4e7d-85dd-bd25e4bcce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:48.247892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd7b81-247a-4e7d-85dd-bd25e4bcce22 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:48.248240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd7b81-247a-4e7d-85dd-bd25e4bcce22 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:48.248584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd7b81-247a-4e7d-85dd-bd25e4bcce22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-781a1b0e-0ea4-467b-9b32-7a57968a0de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:48.249732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:48.252251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:48.253878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:48.253878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:48.253878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:48.253878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 352/710] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:48.254792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473def-baed-410c-9a27-ce840b604415 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:48.255147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473def-baed-410c-9a27-ce840b604415 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:48.255634 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473def-baed-410c-9a27-ce840b604415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:48.268372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd7b81-247a-4e7d-85dd-bd25e4bcce22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:48.270371 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd7b81-247a-4e7d-85dd-bd25e4bcce22 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:48.283360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-9a473def-baed-410c-9a27-ce840b604415 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:48.284978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9a473def-baed-410c-9a27-ce840b604415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-17cd7b81-247a-4e7d-85dd-bd25e4bcce22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:48.289496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:48.290831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:48.296858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:48.296858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:48.296858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:48.296858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 359/711] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:48.296858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd7b81-247a-4e7d-85dd-bd25e4bcce22 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:48.329091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:48.371813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:48.393664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 353/712] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:48.394674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a473def-baed-410c-9a27-ce840b604415 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:48.457331 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd7b81-247a-4e7d-85dd-bd25e4bcce22 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:48.499218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1347a-53bd-4c41-b6fa-4f3f6142d74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:48.499871 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1347a-53bd-4c41-b6fa-4f3f6142d74c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:48.500156 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1347a-53bd-4c41-b6fa-4f3f6142d74c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:48.500524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1347a-53bd-4c41-b6fa-4f3f6142d74c None admin] PATH_INFO: `/v3/services/network` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:48.501164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1347a-53bd-4c41-b6fa-4f3f6142d74c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:48.502555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1347a-53bd-4c41-b6fa-4f3f6142d74c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-37b1347a-53bd-4c41-b6fa-4f3f6142d74c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:48.514795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:48.517083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:48.518180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 360/713] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:48 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:48.519164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1347a-53bd-4c41-b6fa-4f3f6142d74c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:48.561076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a473def-baed-410c-9a27-ce840b604415 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:48.608290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57245c5-3684-4e93-b85e-dfd567ec9ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:48.609139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57245c5-3684-4e93-b85e-dfd567ec9ef0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:48.609785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57245c5-3684-4e93-b85e-dfd567ec9ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:48.610250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57245c5-3684-4e93-b85e-dfd567ec9ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:48.611490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57245c5-3684-4e93-b85e-dfd567ec9ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:48.612279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57245c5-3684-4e93-b85e-dfd567ec9ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:48.614142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57245c5-3684-4e93-b85e-dfd567ec9ef0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:48.631652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 354/714] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:48.634143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57245c5-3684-4e93-b85e-dfd567ec9ef0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:48.668561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1347a-53bd-4c41-b6fa-4f3f6142d74c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:48.673362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:48.705125 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:48.732491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e2df8-843e-44e6-881d-2122b5d9174c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:48.733153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2df8-843e-44e6-881d-2122b5d9174c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:48.733434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2df8-843e-44e6-881d-2122b5d9174c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:48.733706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2df8-843e-44e6-881d-2122b5d9174c None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:48.734553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e2df8-843e-44e6-881d-2122b5d9174c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:48.734859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e2df8-843e-44e6-881d-2122b5d9174c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:48.736307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e2df8-843e-44e6-881d-2122b5d9174c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:48.751792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 361/715] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:48.752679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e2df8-843e-44e6-881d-2122b5d9174c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:48.776239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57245c5-3684-4e93-b85e-dfd567ec9ef0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:48.816333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055213-29ad-405e-92c7-5f70ca4259d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:48.816988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055213-29ad-405e-92c7-5f70ca4259d3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:48.817311 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055213-29ad-405e-92c7-5f70ca4259d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:48.817559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055213-29ad-405e-92c7-5f70ca4259d3 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:48.818173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23055213-29ad-405e-92c7-5f70ca4259d3 None admin] RBAC: Adding query filter params (name=network) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:48.818477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23055213-29ad-405e-92c7-5f70ca4259d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:48.819872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23055213-29ad-405e-92c7-5f70ca4259d3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:48.833140 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 355/716] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:37:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:48.833140 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055213-29ad-405e-92c7-5f70ca4259d3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:48.905919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e2df8-843e-44e6-881d-2122b5d9174c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:48.965891 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:48.975960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d1456-ef14-4a24-bd4a-f7aab99f25d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:48.979945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d1456-ef14-4a24-bd4a-f7aab99f25d0 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:48.979945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d1456-ef14-4a24-bd4a-f7aab99f25d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:48.979945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d1456-ef14-4a24-bd4a-f7aab99f25d0 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:48.979945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d1456-ef14-4a24-bd4a-f7aab99f25d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:48.980863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d1456-ef14-4a24-bd4a-f7aab99f25d0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:48.984588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23055213-29ad-405e-92c7-5f70ca4259d3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:49.035656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a49dee-0834-4662-bddd-afdce8579430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:49.036427 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a49dee-0834-4662-bddd-afdce8579430 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:49.036736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a49dee-0834-4662-bddd-afdce8579430 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:49.037015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a49dee-0834-4662-bddd-afdce8579430 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:49.037810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a49dee-0834-4662-bddd-afdce8579430 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:49.039411 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a49dee-0834-4662-bddd-afdce8579430 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:49.088283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 362/717] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:37:48 2022] POST /identity/v3/users => generated 254 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:37:49.089214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d1456-ef14-4a24-bd4a-f7aab99f25d0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:49.137593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:49.192544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 356/718] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:37:48 2022] POST /identity/v3/services => generated 251 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:37:49.192544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a49dee-0834-4662-bddd-afdce8579430 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:49.274794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d1456-ef14-4a24-bd4a-f7aab99f25d0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:49.374825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d73a04-4e76-4633-88a6-5a13382b7c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:49.375485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73a04-4e76-4633-88a6-5a13382b7c1f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:49.375767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73a04-4e76-4633-88a6-5a13382b7c1f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:49.377098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73a04-4e76-4633-88a6-5a13382b7c1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:49.391170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d73a04-4e76-4633-88a6-5a13382b7c1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:49.392825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d73a04-4e76-4633-88a6-5a13382b7c1f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-a2d73a04-4e76-4633-88a6-5a13382b7c1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:49.408449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:49.409633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:49.410627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:49.410627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:49.410627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:49.410627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:49.410627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:49.410627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:49.410627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:49.410627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:49.410627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 363/719] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:49.415137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a49dee-0834-4662-bddd-afdce8579430 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:49.419923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc627bc-e5db-4b45-abb6-f7c8ff996539 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:49.420340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc627bc-e5db-4b45-abb6-f7c8ff996539 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:49.420794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc627bc-e5db-4b45-abb6-f7c8ff996539 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:49.422636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 364/720] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:37:49.423603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc627bc-e5db-4b45-abb6-f7c8ff996539 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:49.458206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d12a1-fbfe-4dc7-88a8-3b9eb0dff347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:49.459416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d12a1-fbfe-4dc7-88a8-3b9eb0dff347 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:49.460022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d12a1-fbfe-4dc7-88a8-3b9eb0dff347 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:49.460483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d12a1-fbfe-4dc7-88a8-3b9eb0dff347 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:49.462283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d12a1-fbfe-4dc7-88a8-3b9eb0dff347 None admin] RBAC: Adding query filter params (type=network) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:49.462816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d12a1-fbfe-4dc7-88a8-3b9eb0dff347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:49.464748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d12a1-fbfe-4dc7-88a8-3b9eb0dff347 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:49.472409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 357/721] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:37:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:49.472630 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be818d3b-6ad1-423a-a23c-97e703213c01 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:49.472916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be818d3b-6ad1-423a-a23c-97e703213c01 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:49.473194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be818d3b-6ad1-423a-a23c-97e703213c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:49.495279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-be818d3b-6ad1-423a-a23c-97e703213c01 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:49.496506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-be818d3b-6ad1-423a-a23c-97e703213c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:49.501514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:49.598201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:49.607613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 358/722] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:49.630092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc627bc-e5db-4b45-abb6-f7c8ff996539 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:49.682684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792f729-cb3b-4ce2-bfdc-be9fc3e0e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:49.683313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792f729-cb3b-4ce2-bfdc-be9fc3e0e55b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:49.683615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792f729-cb3b-4ce2-bfdc-be9fc3e0e55b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:49.683911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792f729-cb3b-4ce2-bfdc-be9fc3e0e55b None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:49.684640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792f729-cb3b-4ce2-bfdc-be9fc3e0e55b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:49.684952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792f729-cb3b-4ce2-bfdc-be9fc3e0e55b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:49.687129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792f729-cb3b-4ce2-bfdc-be9fc3e0e55b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:49.702815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 365/723] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:49.708543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be818d3b-6ad1-423a-a23c-97e703213c01 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:49.828622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be818d3b-6ad1-423a-a23c-97e703213c01 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:49.882604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fefeb-3635-4069-b410-60a08e2fc380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:49.883173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fefeb-3635-4069-b410-60a08e2fc380 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:49.883456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fefeb-3635-4069-b410-60a08e2fc380 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:49.883731 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fefeb-3635-4069-b410-60a08e2fc380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:49.884473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fefeb-3635-4069-b410-60a08e2fc380 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=1c12495a6cf64c80b45785f185f28383) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:49.884812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fefeb-3635-4069-b410-60a08e2fc380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:49.886539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fefeb-3635-4069-b410-60a08e2fc380 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:49.897722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 359/724] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:49 2022] GET /identity/v3/role_assignments?user.id=1c12495a6cf64c80b45785f185f28383&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=eeb6551eeb934053866fc821b511b5dd => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:50.019982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792f729-cb3b-4ce2-bfdc-be9fc3e0e55b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:50.155195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792f729-cb3b-4ce2-bfdc-be9fc3e0e55b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:50.192718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bc1ab-cf85-45e5-90d0-2a69fd4a8164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:50.193358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bc1ab-cf85-45e5-90d0-2a69fd4a8164 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:50.193726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bc1ab-cf85-45e5-90d0-2a69fd4a8164 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:50.194006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bc1ab-cf85-45e5-90d0-2a69fd4a8164 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:50.204815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bc1ab-cf85-45e5-90d0-2a69fd4a8164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-094bc1ab-cf85-45e5-90d0-2a69fd4a8164 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:50.209794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:50.210782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:50.212056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 366/725] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:50.216823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fefeb-3635-4069-b410-60a08e2fc380 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:50.233694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:50.383191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fefeb-3635-4069-b410-60a08e2fc380 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:50.439724 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bbf00-d83c-4485-8f05-1e50219a9386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:50.440334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bbf00-d83c-4485-8f05-1e50219a9386 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:50.440623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bbf00-d83c-4485-8f05-1e50219a9386 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:50.440805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bbf00-d83c-4485-8f05-1e50219a9386 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:50.441481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bbf00-d83c-4485-8f05-1e50219a9386 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:50.441780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bbf00-d83c-4485-8f05-1e50219a9386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:50.443178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bbf00-d83c-4485-8f05-1e50219a9386 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:50.456790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 360/726] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:50.462469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bc1ab-cf85-45e5-90d0-2a69fd4a8164 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:50.486897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:50.653088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bc1ab-cf85-45e5-90d0-2a69fd4a8164 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:50.699480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af991b-d345-4003-bdb2-dab89706ebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:50.700070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af991b-d345-4003-bdb2-dab89706ebad None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:50.700342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af991b-d345-4003-bdb2-dab89706ebad None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:50.700636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af991b-d345-4003-bdb2-dab89706ebad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:50.718487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af991b-d345-4003-bdb2-dab89706ebad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:50.720026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af991b-d345-4003-bdb2-dab89706ebad None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-c0af991b-d345-4003-bdb2-dab89706ebad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:50.746993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:50.748610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:50.750092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:50.750092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:50.750092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:50.750092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 367/727] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:50.755051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bbf00-d83c-4485-8f05-1e50219a9386 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:50.870443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:50.912802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bbf00-d83c-4485-8f05-1e50219a9386 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:50.969245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089c9aa-dbb6-4109-982f-57f1a03b1999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:50.969871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089c9aa-dbb6-4109-982f-57f1a03b1999 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:50.970145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089c9aa-dbb6-4109-982f-57f1a03b1999 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:50.970419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089c9aa-dbb6-4109-982f-57f1a03b1999 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:50.971161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089c9aa-dbb6-4109-982f-57f1a03b1999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:50.971466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089c9aa-dbb6-4109-982f-57f1a03b1999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:50.976881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089c9aa-dbb6-4109-982f-57f1a03b1999 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:50.990704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 361/728] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:50.996989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af991b-d345-4003-bdb2-dab89706ebad None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:51.074803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:51.135679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af991b-d345-4003-bdb2-dab89706ebad None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:51.196262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc77e3-d066-469d-9042-27725a896cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:51.196973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc77e3-d066-469d-9042-27725a896cb3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:51.197254 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc77e3-d066-469d-9042-27725a896cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:51.197524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc77e3-d066-469d-9042-27725a896cb3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:51.206668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc77e3-d066-469d-9042-27725a896cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:51.208168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc77e3-d066-469d-9042-27725a896cb3 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-b4bc77e3-d066-469d-9042-27725a896cb3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:51.225441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:51.226476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:51.228032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 368/729] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:51.233694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089c9aa-dbb6-4109-982f-57f1a03b1999 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:51.401883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089c9aa-dbb6-4109-982f-57f1a03b1999 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:51.439292 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:51.454092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af72fb-a9b6-49e7-aa9c-64f54a0bd02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:51.455279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af72fb-a9b6-49e7-aa9c-64f54a0bd02c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:51.455279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af72fb-a9b6-49e7-aa9c-64f54a0bd02c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:51.455279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af72fb-a9b6-49e7-aa9c-64f54a0bd02c None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:51.455998 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af72fb-a9b6-49e7-aa9c-64f54a0bd02c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:51.456302 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af72fb-a9b6-49e7-aa9c-64f54a0bd02c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:51.457782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af72fb-a9b6-49e7-aa9c-64f54a0bd02c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:51.489114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 362/730] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 15:37:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:51.490457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc77e3-d066-469d-9042-27725a896cb3 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:51.676864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc77e3-d066-469d-9042-27725a896cb3 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:51.712592 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:51.733373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa9030-256f-4110-85a8-3f3a9f638396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:51.734006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9030-256f-4110-85a8-3f3a9f638396 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:51.734286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9030-256f-4110-85a8-3f3a9f638396 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:51.734550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9030-256f-4110-85a8-3f3a9f638396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:51.745916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c2e5c-ebaf-4df6-8953-77cbf090890c None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:51.746152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c2e5c-ebaf-4df6-8953-77cbf090890c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:51.746374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c2e5c-ebaf-4df6-8953-77cbf090890c None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:51.748025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 363/731] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:37:51.753420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ffdcd-ed7a-4920-a8f1-ec93dcbdba30 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:51.753797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ffdcd-ed7a-4920-a8f1-ec93dcbdba30 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:51.754078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ffdcd-ed7a-4920-a8f1-ec93dcbdba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:51.774267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ec5ffdcd-ed7a-4920-a8f1-ec93dcbdba30 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:51.775478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ec5ffdcd-ed7a-4920-a8f1-ec93dcbdba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:51.879645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa9030-256f-4110-85a8-3f3a9f638396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:51.880763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 364/732] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:51.881711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa9030-256f-4110-85a8-3f3a9f638396 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:51.882440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd26e-eb37-4641-9847-6874564d1623 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:51.882922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd26e-eb37-4641-9847-6874564d1623 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:51.883862 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbd26e-eb37-4641-9847-6874564d1623 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:51.886118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 365/733] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:51.892612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ba211-1c15-4c6b-a4a9-0b2236938deb None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:51.893230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ba211-1c15-4c6b-a4a9-0b2236938deb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:51.893675 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ba211-1c15-4c6b-a4a9-0b2236938deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:51.925300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d99ba211-1c15-4c6b-a4a9-0b2236938deb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:51.926887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d99ba211-1c15-4c6b-a4a9-0b2236938deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:52.017076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 369/734] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:51 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:37:52.018570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dda64-6f12-4140-92a5-2d1731e91711 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:52.019048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dda64-6f12-4140-92a5-2d1731e91711 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:52.019450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dda64-6f12-4140-92a5-2d1731e91711 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:52.021147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 370/735] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:52.022060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dda64-6f12-4140-92a5-2d1731e91711 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:52.048176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:52.052913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 366/736] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:37:52.054647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d421f4-d7b7-4912-a5c8-b50360ed2fba None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:52.055662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d421f4-d7b7-4912-a5c8-b50360ed2fba None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:52.056791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d421f4-d7b7-4912-a5c8-b50360ed2fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:52.095728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-68d421f4-d7b7-4912-a5c8-b50360ed2fba None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:52.097318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-68d421f4-d7b7-4912-a5c8-b50360ed2fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:52.170194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:52.214380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52dda64-6f12-4140-92a5-2d1731e91711 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:52.219996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 367/737] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:37:52.221142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d421f4-d7b7-4912-a5c8-b50360ed2fba None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:52.257781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b416a-b1e2-4f14-b7ec-b8b4411a181a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:52.258943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b416a-b1e2-4f14-b7ec-b8b4411a181a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:52.259401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b416a-b1e2-4f14-b7ec-b8b4411a181a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:52.259844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b416a-b1e2-4f14-b7ec-b8b4411a181a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:52.272494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b416a-b1e2-4f14-b7ec-b8b4411a181a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:52.274795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b416a-b1e2-4f14-b7ec-b8b4411a181a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-980b416a-b1e2-4f14-b7ec-b8b4411a181a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:52.292316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:52.293387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:52.294343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:52.294343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:52.294343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:52.296743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 371/738] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:52.302291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b416a-b1e2-4f14-b7ec-b8b4411a181a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:52.385967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:52.420939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b416a-b1e2-4f14-b7ec-b8b4411a181a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:52.453274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d421f4-d7b7-4912-a5c8-b50360ed2fba None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:52.464249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4d18a-81ea-4f7e-a1eb-660da7806672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:52.465322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d18a-81ea-4f7e-a1eb-660da7806672 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:52.466747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d18a-81ea-4f7e-a1eb-660da7806672 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:52.467023 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4d18a-81ea-4f7e-a1eb-660da7806672 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:52.467673 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4d18a-81ea-4f7e-a1eb-660da7806672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:52.467976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4d18a-81ea-4f7e-a1eb-660da7806672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:52.469444 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4d18a-81ea-4f7e-a1eb-660da7806672 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:52.483727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 372/739] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:52.484800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4d18a-81ea-4f7e-a1eb-660da7806672 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:52.498449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825782-8378-4745-bae6-8f63a6405536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:52.500446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825782-8378-4745-bae6-8f63a6405536 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:52.501050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825782-8378-4745-bae6-8f63a6405536 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:52.501544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825782-8378-4745-bae6-8f63a6405536 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:52.514672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5825782-8378-4745-bae6-8f63a6405536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-b5825782-8378-4745-bae6-8f63a6405536 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:52.519564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:52.520653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 368/740] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:52.521513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825782-8378-4745-bae6-8f63a6405536 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:52.561561 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:52.618546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4d18a-81ea-4f7e-a1eb-660da7806672 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:52.640530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825782-8378-4745-bae6-8f63a6405536 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:52.652026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:52.657469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e49dd-1305-4b14-89be-605e5164ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:52.658112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e49dd-1305-4b14-89be-605e5164ae74 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:52.658390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e49dd-1305-4b14-89be-605e5164ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:52.658739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e49dd-1305-4b14-89be-605e5164ae74 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:52.659281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e49dd-1305-4b14-89be-605e5164ae74 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:52.666693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e49dd-1305-4b14-89be-605e5164ae74 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-257e49dd-1305-4b14-89be-605e5164ae74 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:52.669694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:52.671019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:52.672315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 373/741] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Aug 22 15:37:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:52.674351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e49dd-1305-4b14-89be-605e5164ae74 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:52.678485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f02a2-7964-4868-b08c-e6a91192c38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:52.679179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f02a2-7964-4868-b08c-e6a91192c38e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:52.679465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f02a2-7964-4868-b08c-e6a91192c38e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:52.680237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f02a2-7964-4868-b08c-e6a91192c38e None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:52.687683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f02a2-7964-4868-b08c-e6a91192c38e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:52.689227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f02a2-7964-4868-b08c-e6a91192c38e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-bc1f02a2-7964-4868-b08c-e6a91192c38e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:52.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:52.703268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:52.704422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:52.704422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:52.704422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:52.704422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:52.704422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:52.704422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:52.704422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:52.704422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:52.704422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 369/742] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:52.704422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f02a2-7964-4868-b08c-e6a91192c38e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:52.779753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e49dd-1305-4b14-89be-605e5164ae74 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:52.807914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:52.814410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f02a2-7964-4868-b08c-e6a91192c38e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:52.816394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb7db-1717-428d-9d28-0246272f801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:52.817050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb7db-1717-428d-9d28-0246272f801a None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:52.817333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb7db-1717-428d-9d28-0246272f801a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:52.817609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffb7db-1717-428d-9d28-0246272f801a None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:52.818259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb7db-1717-428d-9d28-0246272f801a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:52.819750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffb7db-1717-428d-9d28-0246272f801a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:52.860101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891e041-f7ad-42f5-9665-22be6dc7c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:52.860733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891e041-f7ad-42f5-9665-22be6dc7c723 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:52.861013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891e041-f7ad-42f5-9665-22be6dc7c723 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:52.861289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891e041-f7ad-42f5-9665-22be6dc7c723 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:52.861947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891e041-f7ad-42f5-9665-22be6dc7c723 None admin] RBAC: Adding query filter params (name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:52.862242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891e041-f7ad-42f5-9665-22be6dc7c723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:52.863596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891e041-f7ad-42f5-9665-22be6dc7c723 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:52.872260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 370/743] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:52.873693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4fd3-3992-46bc-bfed-dd65d9e86c9c None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:52.873976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4fd3-3992-46bc-bfed-dd65d9e86c9c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:52.874244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4fd3-3992-46bc-bfed-dd65d9e86c9c None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:52.875468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 371/744] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:52.876325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4fd3-3992-46bc-bfed-dd65d9e86c9c None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:52.922324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 374/745] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:37:52 2022] POST /identity/v3/services => generated 240 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:37:52.923287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb7db-1717-428d-9d28-0246272f801a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:53.005778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:53.011873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d4fd3-3992-46bc-bfed-dd65d9e86c9c None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:53.054258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6e09e-c426-460c-bc65-e779262ea139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:53.055493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6e09e-c426-460c-bc65-e779262ea139 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:53.055832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6e09e-c426-460c-bc65-e779262ea139 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:53.056128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6e09e-c426-460c-bc65-e779262ea139 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:53.056783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6e09e-c426-460c-bc65-e779262ea139 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:53.057092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6e09e-c426-460c-bc65-e779262ea139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:53.058511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6e09e-c426-460c-bc65-e779262ea139 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:53.059967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffb7db-1717-428d-9d28-0246272f801a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:53.068982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 372/746] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 15:37:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:53.068982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6e09e-c426-460c-bc65-e779262ea139 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:53.093609 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:53.104599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f38228-a199-4aa5-ade9-5d989de858b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:53.105252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f38228-a199-4aa5-ade9-5d989de858b7 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:53.105537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f38228-a199-4aa5-ade9-5d989de858b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:53.105812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f38228-a199-4aa5-ade9-5d989de858b7 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:53.107291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f38228-a199-4aa5-ade9-5d989de858b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:53.107291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f38228-a199-4aa5-ade9-5d989de858b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:53.108589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f38228-a199-4aa5-ade9-5d989de858b7 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:53.130901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 375/747] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:53.133057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d6ba5-8bf3-486c-9e1a-64b7cbbbc1a5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:53.133475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d6ba5-8bf3-486c-9e1a-64b7cbbbc1a5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:53.133806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d6ba5-8bf3-486c-9e1a-64b7cbbbc1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:53.154959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-6c7d6ba5-8bf3-486c-9e1a-64b7cbbbc1a5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:53.156162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6c7d6ba5-8bf3-486c-9e1a-64b7cbbbc1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:53.203504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6e09e-c426-460c-bc65-e779262ea139 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:53.236561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 376/748] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:37:53.236561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d6ba5-8bf3-486c-9e1a-64b7cbbbc1a5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:53.247196 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d463ff8-4670-488b-8c21-acfe97b6ff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:53.248079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d463ff8-4670-488b-8c21-acfe97b6ff79 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:53.248594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d463ff8-4670-488b-8c21-acfe97b6ff79 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:53.249066 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d463ff8-4670-488b-8c21-acfe97b6ff79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:53.261548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d463ff8-4670-488b-8c21-acfe97b6ff79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:53.263484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d463ff8-4670-488b-8c21-acfe97b6ff79 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-1d463ff8-4670-488b-8c21-acfe97b6ff79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:53.282589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:53.283865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:53.284893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:53.284893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:53.284893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:53.285937 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:53.288271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 373/749] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:53.290339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d463ff8-4670-488b-8c21-acfe97b6ff79 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:53.341659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d6ba5-8bf3-486c-9e1a-64b7cbbbc1a5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:53.373780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:53.379484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997c28b-2b3b-40aa-942d-adbb6c2693c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:53.379661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997c28b-2b3b-40aa-942d-adbb6c2693c4 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:53.379779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997c28b-2b3b-40aa-942d-adbb6c2693c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:53.380049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997c28b-2b3b-40aa-942d-adbb6c2693c4 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:53.380712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997c28b-2b3b-40aa-942d-adbb6c2693c4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:53.381012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997c28b-2b3b-40aa-942d-adbb6c2693c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:53.382389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997c28b-2b3b-40aa-942d-adbb6c2693c4 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:53.389208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 377/750] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 15:37:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:53.395704 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997c28b-2b3b-40aa-942d-adbb6c2693c4 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:53.416351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d463ff8-4670-488b-8c21-acfe97b6ff79 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:53.459158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3c159-c54d-4274-849b-50fbe6bd9652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:53.459840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3c159-c54d-4274-849b-50fbe6bd9652 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:53.460120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3c159-c54d-4274-849b-50fbe6bd9652 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:53.460387 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3c159-c54d-4274-849b-50fbe6bd9652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:53.461681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3c159-c54d-4274-849b-50fbe6bd9652 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=92bc91b8b5224bd18f79bd8ea4663d3f) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:53.461992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3c159-c54d-4274-849b-50fbe6bd9652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:53.464557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3c159-c54d-4274-849b-50fbe6bd9652 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:53.472925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 374/751] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:53 2022] GET /identity/v3/role_assignments?user.id=92bc91b8b5224bd18f79bd8ea4663d3f&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=eeb6551eeb934053866fc821b511b5dd => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:53.473858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3c159-c54d-4274-849b-50fbe6bd9652 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:53.537327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997c28b-2b3b-40aa-942d-adbb6c2693c4 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:53.561123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:53.600477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2901-a88c-4a5e-a770-7bd5d0409884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:53.602417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2901-a88c-4a5e-a770-7bd5d0409884 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:53.602695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2901-a88c-4a5e-a770-7bd5d0409884 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:53.602971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d2901-a88c-4a5e-a770-7bd5d0409884 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:53.603979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2901-a88c-4a5e-a770-7bd5d0409884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:53.604288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2901-a88c-4a5e-a770-7bd5d0409884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:53.606087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d2901-a88c-4a5e-a770-7bd5d0409884 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:53.628471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 378/752] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:53.633506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2901-a88c-4a5e-a770-7bd5d0409884 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:53.658418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3c159-c54d-4274-849b-50fbe6bd9652 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:53.693236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:53.703750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af21ffd-d5c3-4c36-aad2-5609c433d0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:53.704380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21ffd-d5c3-4c36-aad2-5609c433d0ba None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:53.704695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21ffd-d5c3-4c36-aad2-5609c433d0ba None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:53.705546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21ffd-d5c3-4c36-aad2-5609c433d0ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:53.705923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af21ffd-d5c3-4c36-aad2-5609c433d0ba None admin] RBAC: Adding query filter params (interface=public, service_id=9c83aae1be7145f3bdbf816cebc3c801, region_id=RegionOne) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:53.706778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af21ffd-d5c3-4c36-aad2-5609c433d0ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:53.708995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af21ffd-d5c3-4c36-aad2-5609c433d0ba None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:53.724704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 375/753] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 15:37:53 2022] GET /identity/v3/endpoints?service_id=9c83aae1be7145f3bdbf816cebc3c801&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:53.727053 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af21ffd-d5c3-4c36-aad2-5609c433d0ba None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:53.815357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d2901-a88c-4a5e-a770-7bd5d0409884 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:53.871980 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af21ffd-d5c3-4c36-aad2-5609c433d0ba None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:53.876401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0a2ba-40cb-4d31-b3cf-43662269b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:53.877671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0a2ba-40cb-4d31-b3cf-43662269b67f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:53.878321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0a2ba-40cb-4d31-b3cf-43662269b67f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:53.878951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0a2ba-40cb-4d31-b3cf-43662269b67f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:53.897781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0a2ba-40cb-4d31-b3cf-43662269b67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-13e0a2ba-40cb-4d31-b3cf-43662269b67f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:53.907218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:53.908391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:53.909428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 379/754] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:53.916067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0a2ba-40cb-4d31-b3cf-43662269b67f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:53.917290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acb26c-3c7b-4a48-954b-a07e13c1a3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:53.918272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb26c-3c7b-4a48-954b-a07e13c1a3b3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:53.918759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb26c-3c7b-4a48-954b-a07e13c1a3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:53.919210 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb26c-3c7b-4a48-954b-a07e13c1a3b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:53.931521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acb26c-3c7b-4a48-954b-a07e13c1a3b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:53.933342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acb26c-3c7b-4a48-954b-a07e13c1a3b3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-d6acb26c-3c7b-4a48-954b-a07e13c1a3b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:53.951469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:53.952525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:53.953517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 376/755] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 15:37:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:53.958626 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acb26c-3c7b-4a48-954b-a07e13c1a3b3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:53.974214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:54.027149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:54.059921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0a2ba-40cb-4d31-b3cf-43662269b67f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:54.078058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acb26c-3c7b-4a48-954b-a07e13c1a3b3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:54.117960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dfd5c-87c3-4565-8566-990dac693f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:54.118699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dfd5c-87c3-4565-8566-990dac693f0f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:54.119039 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dfd5c-87c3-4565-8566-990dac693f0f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:54.119579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2dfd5c-87c3-4565-8566-990dac693f0f None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:54.120004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df744b7d-0d73-48e7-b462-fc5dfa7d6255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:54.120555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dfd5c-87c3-4565-8566-990dac693f0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:54.120782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df744b7d-0d73-48e7-b462-fc5dfa7d6255 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:54.121130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df744b7d-0d73-48e7-b462-fc5dfa7d6255 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:54.121474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df744b7d-0d73-48e7-b462-fc5dfa7d6255 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:54.122282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df744b7d-0d73-48e7-b462-fc5dfa7d6255 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:54.122599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df744b7d-0d73-48e7-b462-fc5dfa7d6255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:54.122853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2dfd5c-87c3-4565-8566-990dac693f0f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:54.124088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df744b7d-0d73-48e7-b462-fc5dfa7d6255 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:54.131403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 380/756] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 15:37:53 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:54.132707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dfd5c-87c3-4565-8566-990dac693f0f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:54.140043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 377/757] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:54.141304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df744b7d-0d73-48e7-b462-fc5dfa7d6255 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:54.280349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:54.286732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df744b7d-0d73-48e7-b462-fc5dfa7d6255 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:54.288385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2dfd5c-87c3-4565-8566-990dac693f0f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:54.332650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:54.347314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7575d-6bce-43ea-99b0-b411cd229135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:54.349129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7575d-6bce-43ea-99b0-b411cd229135 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:54.350719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7575d-6bce-43ea-99b0-b411cd229135 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:54.351333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7575d-6bce-43ea-99b0-b411cd229135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:54.368136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cd909-02b0-426f-9a52-ff0dc86c551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:54.369120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cd909-02b0-426f-9a52-ff0dc86c551c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:54.369549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cd909-02b0-426f-9a52-ff0dc86c551c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:54.369965 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cd909-02b0-426f-9a52-ff0dc86c551c None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:54.370946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cd909-02b0-426f-9a52-ff0dc86c551c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:54.371461 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cd909-02b0-426f-9a52-ff0dc86c551c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:54.375014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cd909-02b0-426f-9a52-ff0dc86c551c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:54.380430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7575d-6bce-43ea-99b0-b411cd229135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:54.384535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7575d-6bce-43ea-99b0-b411cd229135 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-e6d7575d-6bce-43ea-99b0-b411cd229135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:54.414162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:54.415465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:54.416682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:54.416682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:54.416682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:54.418538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 378/758] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:54.418858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 381/759] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 15:37:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:54.424698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7575d-6bce-43ea-99b0-b411cd229135 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:54.425494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cd909-02b0-426f-9a52-ff0dc86c551c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:54.558947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7575d-6bce-43ea-99b0-b411cd229135 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:54.562306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cd909-02b0-426f-9a52-ff0dc86c551c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:54.637780 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c574e8f-f4bf-4963-9008-68ba3871ed06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:54.638476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c574e8f-f4bf-4963-9008-68ba3871ed06 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:54.638949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c574e8f-f4bf-4963-9008-68ba3871ed06 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:54.639437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c574e8f-f4bf-4963-9008-68ba3871ed06 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:54.642386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c574e8f-f4bf-4963-9008-68ba3871ed06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:54.642945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c574e8f-f4bf-4963-9008-68ba3871ed06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:54.646768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29b05-7ae4-451e-a4f9-871b456f1dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:54.647402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29b05-7ae4-451e-a4f9-871b456f1dba None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:54.647682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29b05-7ae4-451e-a4f9-871b456f1dba None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:54.647988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29b05-7ae4-451e-a4f9-871b456f1dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:54.649249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c574e8f-f4bf-4963-9008-68ba3871ed06 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:54.679293 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 382/760] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:54.683148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c574e8f-f4bf-4963-9008-68ba3871ed06 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:54.724928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:54.736455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:54.771552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e29b05-7ae4-451e-a4f9-871b456f1dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:54.773931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e29b05-7ae4-451e-a4f9-871b456f1dba None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:54.893592 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c574e8f-f4bf-4963-9008-68ba3871ed06 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:54.942665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2edd5b-655f-40ac-b8a3-194c300730ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:54.943695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2edd5b-655f-40ac-b8a3-194c300730ae None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:54.945408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2edd5b-655f-40ac-b8a3-194c300730ae None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:54.946717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2edd5b-655f-40ac-b8a3-194c300730ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:54.967000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 379/761] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:37:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:37:54.967885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2edd5b-655f-40ac-b8a3-194c300730ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:54.969619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2edd5b-655f-40ac-b8a3-194c300730ae None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:54.978154 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29b05-7ae4-451e-a4f9-871b456f1dba None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-9d2edd5b-655f-40ac-b8a3-194c300730ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:55.001224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:55.002252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:55.003196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:55.003196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:55.003196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:55.003196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:55.003196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:55.003196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:55.003196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:55.003196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:55.003196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:37:55.003196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:55.008214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 383/762] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 15:37:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:55.012580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2edd5b-655f-40ac-b8a3-194c300730ae None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:55.159043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:55.161902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:55.220473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2edd5b-655f-40ac-b8a3-194c300730ae None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:55.234192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29b05-7ae4-451e-a4f9-871b456f1dba None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:55.260940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba861a2-3b0e-4f46-b735-b2a2060bb5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:55.261911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba861a2-3b0e-4f46-b735-b2a2060bb5cf None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:55.262387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba861a2-3b0e-4f46-b735-b2a2060bb5cf None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:55.262877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba861a2-3b0e-4f46-b735-b2a2060bb5cf None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:55.263943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba861a2-3b0e-4f46-b735-b2a2060bb5cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:55.264564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba861a2-3b0e-4f46-b735-b2a2060bb5cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:55.266557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba861a2-3b0e-4f46-b735-b2a2060bb5cf None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:55.294447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 384/763] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 15:37:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:55.296329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dea93-48fb-4f01-8c8d-60dc323a139e None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:55.296961 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dea93-48fb-4f01-8c8d-60dc323a139e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:55.297329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dea93-48fb-4f01-8c8d-60dc323a139e None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:55.299354 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 385/764] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:55.300197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dea93-48fb-4f01-8c8d-60dc323a139e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:55.303663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72149d-6ade-4df7-bef8-10885d147378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:55.305554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72149d-6ade-4df7-bef8-10885d147378 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:55.306051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72149d-6ade-4df7-bef8-10885d147378 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:55.306500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72149d-6ade-4df7-bef8-10885d147378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:55.321507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72149d-6ade-4df7-bef8-10885d147378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:55.323557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72149d-6ade-4df7-bef8-10885d147378 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-5c72149d-6ade-4df7-bef8-10885d147378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:55.344953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:55.345993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:55.346902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:55.346902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:55.346902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:55.352193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 380/765] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:55.352193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92794e20-a9a0-430c-b1c3-5d71a075297f None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:55.352193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92794e20-a9a0-430c-b1c3-5d71a075297f None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:55.352193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92794e20-a9a0-430c-b1c3-5d71a075297f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:55.381469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-92794e20-a9a0-430c-b1c3-5d71a075297f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:55.383762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-92794e20-a9a0-430c-b1c3-5d71a075297f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:55.438265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dea93-48fb-4f01-8c8d-60dc323a139e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:55.471069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:55.477123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 381/766] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:37:55.477995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92794e20-a9a0-430c-b1c3-5d71a075297f None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:55.478496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60626fb-27d4-41d2-a66a-95918f60b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:55.479384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60626fb-27d4-41d2-a66a-95918f60b117 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:55.479888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60626fb-27d4-41d2-a66a-95918f60b117 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:55.480355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60626fb-27d4-41d2-a66a-95918f60b117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:55.493295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60626fb-27d4-41d2-a66a-95918f60b117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:55.495162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60626fb-27d4-41d2-a66a-95918f60b117 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-b60626fb-27d4-41d2-a66a-95918f60b117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:55.512209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:55.513285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:55.514203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:55.514203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:55.514203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:55.516362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 386/767] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:55.522196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60626fb-27d4-41d2-a66a-95918f60b117 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:55.549161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:55.603143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92794e20-a9a0-430c-b1c3-5d71a075297f None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:55.642533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884b1a2-8df7-4008-a166-3e53317b1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:55.643496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884b1a2-8df7-4008-a166-3e53317b1f0a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:55.643976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884b1a2-8df7-4008-a166-3e53317b1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:55.644466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884b1a2-8df7-4008-a166-3e53317b1f0a None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:55.645461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884b1a2-8df7-4008-a166-3e53317b1f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:55.645979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884b1a2-8df7-4008-a166-3e53317b1f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:55.647814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884b1a2-8df7-4008-a166-3e53317b1f0a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:55.661531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 382/768] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:55.673780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884b1a2-8df7-4008-a166-3e53317b1f0a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:55.710139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60626fb-27d4-41d2-a66a-95918f60b117 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:55.749484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083da9a-68ac-4e70-aa57-7a787cfd71df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:55.750475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083da9a-68ac-4e70-aa57-7a787cfd71df None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:55.750963 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083da9a-68ac-4e70-aa57-7a787cfd71df None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:55.751345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083da9a-68ac-4e70-aa57-7a787cfd71df None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:55.752401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083da9a-68ac-4e70-aa57-7a787cfd71df None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:55.753166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083da9a-68ac-4e70-aa57-7a787cfd71df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:55.754967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083da9a-68ac-4e70-aa57-7a787cfd71df None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:55.769413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 387/769] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:55.781650 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083da9a-68ac-4e70-aa57-7a787cfd71df None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:55.851068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:55.886181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884b1a2-8df7-4008-a166-3e53317b1f0a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:55.905023 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:55.927008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083da9a-68ac-4e70-aa57-7a787cfd71df None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:55.933768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344d86c-ea9b-4886-9cb5-434db1ffb0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:55.934653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344d86c-ea9b-4886-9cb5-434db1ffb0d5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:55.935094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344d86c-ea9b-4886-9cb5-434db1ffb0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:55.936017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344d86c-ea9b-4886-9cb5-434db1ffb0d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:55.945875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344d86c-ea9b-4886-9cb5-434db1ffb0d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:55.948022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344d86c-ea9b-4886-9cb5-434db1ffb0d5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:55.970353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f0a31-1f52-412c-b34f-fb1d2e5e0464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:55.971200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0a31-1f52-412c-b34f-fb1d2e5e0464 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:55.971578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0a31-1f52-412c-b34f-fb1d2e5e0464 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:55.971944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0a31-1f52-412c-b34f-fb1d2e5e0464 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-4344d86c-ea9b-4886-9cb5-434db1ffb0d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:55.972166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:55.973275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:55.974417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:55.974417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:55.974417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:55.974417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:55.974417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:55.974417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:55.974417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:55.974417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:55.976734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 383/770] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:55.978423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344d86c-ea9b-4886-9cb5-434db1ffb0d5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:55.986714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f0a31-1f52-412c-b34f-fb1d2e5e0464 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:55.987394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f0a31-1f52-412c-b34f-fb1d2e5e0464 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-f92f0a31-1f52-412c-b34f-fb1d2e5e0464 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:56.000643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:56.001645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:56.002590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:56.002590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:56.002590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:56.002590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:56.002590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:56.002590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:56.002590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:56.002590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:56.002590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 388/771] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:56.003250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f0a31-1f52-412c-b34f-fb1d2e5e0464 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:56.131775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f0a31-1f52-412c-b34f-fb1d2e5e0464 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:56.133973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:56.175332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4535c-09cd-47f1-8676-67b0c8281503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:56.176307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4535c-09cd-47f1-8676-67b0c8281503 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.176870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4535c-09cd-47f1-8676-67b0c8281503 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.177383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4535c-09cd-47f1-8676-67b0c8281503 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.179014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4535c-09cd-47f1-8676-67b0c8281503 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:56.179014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4535c-09cd-47f1-8676-67b0c8281503 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:56.180970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4535c-09cd-47f1-8676-67b0c8281503 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:56.205625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 389/772] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:56.206361 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4535c-09cd-47f1-8676-67b0c8281503 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:56.233216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344d86c-ea9b-4886-9cb5-434db1ffb0d5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:56.272753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d315f76-9183-40f2-88d2-07e4591774e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:56.273570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d315f76-9183-40f2-88d2-07e4591774e0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.273885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d315f76-9183-40f2-88d2-07e4591774e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.274188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d315f76-9183-40f2-88d2-07e4591774e0 None admin] PATH_INFO: `/v3/services/network` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.274790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d315f76-9183-40f2-88d2-07e4591774e0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:56.276275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d315f76-9183-40f2-88d2-07e4591774e0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-4d315f76-9183-40f2-88d2-07e4591774e0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:56.286511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:56.287585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:56.288437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 384/773] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:55 2022] GET /identity/v3/services/network => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:56.289370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb124bc-3c1f-4b3e-8ccb-550bbb4f5a06 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.289370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb124bc-3c1f-4b3e-8ccb-550bbb4f5a06 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.289370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb124bc-3c1f-4b3e-8ccb-550bbb4f5a06 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.292551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 385/774] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:56.292551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb124bc-3c1f-4b3e-8ccb-550bbb4f5a06 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:56.336057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:56.347323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4535c-09cd-47f1-8676-67b0c8281503 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:56.385322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f94db8-e2f6-42f0-9158-77e0dd2484d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:56.386307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f94db8-e2f6-42f0-9158-77e0dd2484d5 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.386450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f94db8-e2f6-42f0-9158-77e0dd2484d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.387093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f94db8-e2f6-42f0-9158-77e0dd2484d5 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.387809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f94db8-e2f6-42f0-9158-77e0dd2484d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:56.388117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f94db8-e2f6-42f0-9158-77e0dd2484d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:56.389594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f94db8-e2f6-42f0-9158-77e0dd2484d5 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:56.402155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 390/775] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:56.407770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f94db8-e2f6-42f0-9158-77e0dd2484d5 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:56.415842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb124bc-3c1f-4b3e-8ccb-550bbb4f5a06 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:56.434381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:56.456616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4705e-d91a-4e42-9507-fdbff6afc202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:56.457228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4705e-d91a-4e42-9507-fdbff6afc202 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.457592 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4705e-d91a-4e42-9507-fdbff6afc202 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.457766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4705e-d91a-4e42-9507-fdbff6afc202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.458496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4705e-d91a-4e42-9507-fdbff6afc202 None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=3f087c40f6514c3a84a4131bc5585fea) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:56.458806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4705e-d91a-4e42-9507-fdbff6afc202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:56.460240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4705e-d91a-4e42-9507-fdbff6afc202 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:56.466359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 386/776] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:37:56 2022] GET /identity/v3/role_assignments?user.id=3f087c40f6514c3a84a4131bc5585fea&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:56.467523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d914f-d9c7-4cc3-b776-4c3a45d9e40b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.467813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d914f-d9c7-4cc3-b776-4c3a45d9e40b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.468088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d914f-d9c7-4cc3-b776-4c3a45d9e40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.487366 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-6a0d914f-d9c7-4cc3-b776-4c3a45d9e40b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:56.496549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6a0d914f-d9c7-4cc3-b776-4c3a45d9e40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:56.548390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f94db8-e2f6-42f0-9158-77e0dd2484d5 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:56.581624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 387/777] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:37:56.582681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d914f-d9c7-4cc3-b776-4c3a45d9e40b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:56.601256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54d422-0880-455d-88ea-fd3b171a7bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:56.602846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54d422-0880-455d-88ea-fd3b171a7bac None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.603127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54d422-0880-455d-88ea-fd3b171a7bac None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.603399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54d422-0880-455d-88ea-fd3b171a7bac None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.604046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54d422-0880-455d-88ea-fd3b171a7bac None admin] RBAC: Adding query filter params (name=network) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:56.604348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54d422-0880-455d-88ea-fd3b171a7bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:56.605958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54d422-0880-455d-88ea-fd3b171a7bac None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:56.612002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 391/778] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:37:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:56.613580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057466-97dd-4af1-9c4b-efcb3e97a2b4 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.613868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057466-97dd-4af1-9c4b-efcb3e97a2b4 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.614140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057466-97dd-4af1-9c4b-efcb3e97a2b4 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.620566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 392/779] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:56.621498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71057466-97dd-4af1-9c4b-efcb3e97a2b4 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:56.634456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:56.726230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d914f-d9c7-4cc3-b776-4c3a45d9e40b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:56.748856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:56.766681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209e817-f94a-4b60-a731-49758acebb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:56.767392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209e817-f94a-4b60-a731-49758acebb3c None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.767705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209e817-f94a-4b60-a731-49758acebb3c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.767992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209e817-f94a-4b60-a731-49758acebb3c None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/1c12495a6cf64c80b45785f185f28383/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.769966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209e817-f94a-4b60-a731-49758acebb3c None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=1c12495a6cf64c80b45785f185f28383, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:56.770558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71057466-97dd-4af1-9c4b-efcb3e97a2b4 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:56.771492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209e817-f94a-4b60-a731-49758acebb3c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:56.814525 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8261b0-de2b-4ef2-951b-9c91c88cde4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:56.815240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8261b0-de2b-4ef2-951b-9c91c88cde4a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.815520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8261b0-de2b-4ef2-951b-9c91c88cde4a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.815795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8261b0-de2b-4ef2-951b-9c91c88cde4a None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.816432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8261b0-de2b-4ef2-951b-9c91c88cde4a None admin] RBAC: Adding query filter params (type=network) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:56.816777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8261b0-de2b-4ef2-951b-9c91c88cde4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:56.818134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8261b0-de2b-4ef2-951b-9c91c88cde4a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:56.823824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 393/780] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:37:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:56.828655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79a979-4974-44f0-ba98-deff94b30554 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:56.828655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79a979-4974-44f0-ba98-deff94b30554 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:56.828655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79a979-4974-44f0-ba98-deff94b30554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:56.849965 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-da79a979-4974-44f0-ba98-deff94b30554 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:56.851165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-da79a979-4974-44f0-ba98-deff94b30554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:56.892933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 388/781] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:37:56 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/1c12495a6cf64c80b45785f185f28383/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:37:56.895522 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209e817-f94a-4b60-a731-49758acebb3c None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:56.989035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 394/782] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:37:56.991652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79a979-4974-44f0-ba98-deff94b30554 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:57.083813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:57.097164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209e817-f94a-4b60-a731-49758acebb3c None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:57.141354 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:57.142019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31a7b4-13c1-421d-8afe-3296dac7d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:57.142769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31a7b4-13c1-421d-8afe-3296dac7d00e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:57.143047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31a7b4-13c1-421d-8afe-3296dac7d00e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:57.143318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31a7b4-13c1-421d-8afe-3296dac7d00e None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:57.144169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31a7b4-13c1-421d-8afe-3296dac7d00e None admin] RBAC: Adding query filter params (interface=public, service_id=94a40d221e034c48b640ea8348148528, region_id=RegionOne) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:57.144475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31a7b4-13c1-421d-8afe-3296dac7d00e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:57.146495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31a7b4-13c1-421d-8afe-3296dac7d00e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:57.153409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 389/783] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 15:37:56 2022] GET /identity/v3/endpoints?service_id=94a40d221e034c48b640ea8348148528&interface=public®ion_id=RegionOne => generated 194 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:57.159079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31a7b4-13c1-421d-8afe-3296dac7d00e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:57.163506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79a979-4974-44f0-ba98-deff94b30554 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:57.223824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aad8fe-f506-4f9a-ad75-9552fb605784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:57.224478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aad8fe-f506-4f9a-ad75-9552fb605784 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:57.224782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aad8fe-f506-4f9a-ad75-9552fb605784 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:57.225058 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aad8fe-f506-4f9a-ad75-9552fb605784 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:57.253119 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aad8fe-f506-4f9a-ad75-9552fb605784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-22aad8fe-f506-4f9a-ad75-9552fb605784 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:57.261134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:57.262285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:37:57.263155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:57.264024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 395/784] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:57.274121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aad8fe-f506-4f9a-ad75-9552fb605784 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:57.319632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31a7b4-13c1-421d-8afe-3296dac7d00e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:57.376585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c641-f0c2-4b04-bf50-03036b996bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:57.377288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c641-f0c2-4b04-bf50-03036b996bfb None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:57.377651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c641-f0c2-4b04-bf50-03036b996bfb None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:57.378010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c641-f0c2-4b04-bf50-03036b996bfb None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:57.378752 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22c641-f0c2-4b04-bf50-03036b996bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:57.380456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22c641-f0c2-4b04-bf50-03036b996bfb None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:57.387077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 390/785] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 15:37:57 2022] GET /identity/v3/services => generated 772 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:57.388644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c641-f0c2-4b04-bf50-03036b996bfb None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:57.420917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:57.476995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aad8fe-f506-4f9a-ad75-9552fb605784 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:57.551485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b9f83-1411-4cff-9991-935f178ae0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:57.554731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b9f83-1411-4cff-9991-935f178ae0b6 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:57.555272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b9f83-1411-4cff-9991-935f178ae0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:57.562211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b9f83-1411-4cff-9991-935f178ae0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:57.563018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b9f83-1411-4cff-9991-935f178ae0b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:57.563252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b9f83-1411-4cff-9991-935f178ae0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:57.564702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b9f83-1411-4cff-9991-935f178ae0b6 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:57.569299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c641-f0c2-4b04-bf50-03036b996bfb None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:57.575187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 396/786] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:57.581320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b9f83-1411-4cff-9991-935f178ae0b6 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:57.584266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:57.623447 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a60d3-8308-4ec7-a8a8-87feeaba099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:57.624739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a60d3-8308-4ec7-a8a8-87feeaba099f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:57.625483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a60d3-8308-4ec7-a8a8-87feeaba099f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:57.626258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a60d3-8308-4ec7-a8a8-87feeaba099f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:57.627154 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a60d3-8308-4ec7-a8a8-87feeaba099f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:57.629019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a60d3-8308-4ec7-a8a8-87feeaba099f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9b8a60d3-8308-4ec7-a8a8-87feeaba099f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:57.643038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:57.644097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:37:57.645003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:57.646534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 391/787] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Aug 22 15:37:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:57.653712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a60d3-8308-4ec7-a8a8-87feeaba099f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:57.723667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b9f83-1411-4cff-9991-935f178ae0b6 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:57.767355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c962aab-8d78-499e-bb9e-85f572ef3279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:57.769319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c962aab-8d78-499e-bb9e-85f572ef3279 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:57.769820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c962aab-8d78-499e-bb9e-85f572ef3279 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:57.770296 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c962aab-8d78-499e-bb9e-85f572ef3279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:57.783015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c962aab-8d78-499e-bb9e-85f572ef3279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:57.785255 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c962aab-8d78-499e-bb9e-85f572ef3279 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:57.794105 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-9c962aab-8d78-499e-bb9e-85f572ef3279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:57.805833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:57.806824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:57.807719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:57.807719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:57.807719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:57.810257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 397/788] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:57.818965 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c962aab-8d78-499e-bb9e-85f572ef3279 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:57.828551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a60d3-8308-4ec7-a8a8-87feeaba099f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:57.863694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8f7f1-5593-4c86-818e-54c46d13bdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:57.864305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8f7f1-5593-4c86-818e-54c46d13bdeb None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:57.864611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8f7f1-5593-4c86-818e-54c46d13bdeb None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:57.864883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8f7f1-5593-4c86-818e-54c46d13bdeb None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:57.865517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8f7f1-5593-4c86-818e-54c46d13bdeb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:57.865819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8f7f1-5593-4c86-818e-54c46d13bdeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:57.868042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8f7f1-5593-4c86-818e-54c46d13bdeb None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:57.873232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 392/789] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 15:37:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:57.878824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8f7f1-5593-4c86-818e-54c46d13bdeb None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:57.958982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:58.051410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c962aab-8d78-499e-bb9e-85f572ef3279 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:58.074719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8f7f1-5593-4c86-818e-54c46d13bdeb None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:58.111210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e01c0f-c43f-40b8-81ec-f1aa89bcc84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:58.111847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e01c0f-c43f-40b8-81ec-f1aa89bcc84e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:58.112127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e01c0f-c43f-40b8-81ec-f1aa89bcc84e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:58.112398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e01c0f-c43f-40b8-81ec-f1aa89bcc84e None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:58.113084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e01c0f-c43f-40b8-81ec-f1aa89bcc84e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:58.113971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e01c0f-c43f-40b8-81ec-f1aa89bcc84e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:58.115426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e01c0f-c43f-40b8-81ec-f1aa89bcc84e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:58.130113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 398/790] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:58.135690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e01c0f-c43f-40b8-81ec-f1aa89bcc84e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:58.158934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598a744-f13b-4e6b-b2b7-b056feaa20ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:58.159558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a744-f13b-4e6b-b2b7-b056feaa20ae None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:58.159900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a744-f13b-4e6b-b2b7-b056feaa20ae None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:58.160176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a744-f13b-4e6b-b2b7-b056feaa20ae None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:58.161505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598a744-f13b-4e6b-b2b7-b056feaa20ae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:58.161810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598a744-f13b-4e6b-b2b7-b056feaa20ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:58.165868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598a744-f13b-4e6b-b2b7-b056feaa20ae None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:58.174708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 393/791] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 15:37:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:37:58.181185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598a744-f13b-4e6b-b2b7-b056feaa20ae None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:58.201279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:58.267248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e01c0f-c43f-40b8-81ec-f1aa89bcc84e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:58.287584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:58.309084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc950b09-381d-47f6-b204-73043e392e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:58.343203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc950b09-381d-47f6-b204-73043e392e87 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:58.343203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc950b09-381d-47f6-b204-73043e392e87 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:58.343203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc950b09-381d-47f6-b204-73043e392e87 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:58.343203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc950b09-381d-47f6-b204-73043e392e87 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:58.343203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc950b09-381d-47f6-b204-73043e392e87 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:58.343203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-bc950b09-381d-47f6-b204-73043e392e87 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:37:58.343203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:58.343739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:58.344696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:58.345632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:37:58.345632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:37:58.345632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:37:58.345632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:37:58.345632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:37:58.345632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:37:58.345632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:37:58.345632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:58.345632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 399/792] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:58.345632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc950b09-381d-47f6-b204-73043e392e87 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:58.400805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598a744-f13b-4e6b-b2b7-b056feaa20ae None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:58.459654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8035ee0-cb74-4e49-b7bc-c8e315387aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:58.460272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035ee0-cb74-4e49-b7bc-c8e315387aab None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:58.460854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035ee0-cb74-4e49-b7bc-c8e315387aab None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:58.461084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035ee0-cb74-4e49-b7bc-c8e315387aab None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:58.461748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8035ee0-cb74-4e49-b7bc-c8e315387aab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:58.463116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8035ee0-cb74-4e49-b7bc-c8e315387aab None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:58.484481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc950b09-381d-47f6-b204-73043e392e87 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:58.523014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a9f8c-22ad-4e1d-bd80-4f6b0841bccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:58.524246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9f8c-22ad-4e1d-bd80-4f6b0841bccb None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:58.524549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9f8c-22ad-4e1d-bd80-4f6b0841bccb None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:58.524828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9f8c-22ad-4e1d-bd80-4f6b0841bccb None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:58.525557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a9f8c-22ad-4e1d-bd80-4f6b0841bccb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:58.525922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a9f8c-22ad-4e1d-bd80-4f6b0841bccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:58.527562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a9f8c-22ad-4e1d-bd80-4f6b0841bccb None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:58.547219 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 400/793] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 15:37:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:58.553614 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a9f8c-22ad-4e1d-bd80-4f6b0841bccb None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:58.587184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:58.630444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 394/794] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:37:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:37:58.669255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd39f1c-4513-46e6-879a-406f308a67ab None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:58.669255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd39f1c-4513-46e6-879a-406f308a67ab None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:58.669255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd39f1c-4513-46e6-879a-406f308a67ab None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:58.669255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 395/795] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:37:58.669741 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a9f8c-22ad-4e1d-bd80-4f6b0841bccb None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:58.669820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7864-671f-4908-82d0-5f00fd9c444e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:58.669820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7864-671f-4908-82d0-5f00fd9c444e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:58.669820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7864-671f-4908-82d0-5f00fd9c444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:58.705052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-0b0a7864-671f-4908-82d0-5f00fd9c444e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:58.706891 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0b0a7864-671f-4908-82d0-5f00fd9c444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:58.714136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd73197-e303-476f-b146-d1acbb249e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:58.727251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd73197-e303-476f-b146-d1acbb249e18 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:58.727251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd73197-e303-476f-b146-d1acbb249e18 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:58.727251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd73197-e303-476f-b146-d1acbb249e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:58.738995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd73197-e303-476f-b146-d1acbb249e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:58.743434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd73197-e303-476f-b146-d1acbb249e18 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-5bd73197-e303-476f-b146-d1acbb249e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:37:58.774037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:58.775069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:37:58.776042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:37:58.776042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:37:58.776042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:58.776634 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 401/796] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:58.786216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd73197-e303-476f-b146-d1acbb249e18 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:58.844262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:58.855769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 396/797] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:37:59.013618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:59.033785 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd73197-e303-476f-b146-d1acbb249e18 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:59.071600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc425f-7b03-4389-972f-956e51f0cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:59.072295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc425f-7b03-4389-972f-956e51f0cd9f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:59.072581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc425f-7b03-4389-972f-956e51f0cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:59.072838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc425f-7b03-4389-972f-956e51f0cd9f None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:59.073489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc425f-7b03-4389-972f-956e51f0cd9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:59.073796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc425f-7b03-4389-972f-956e51f0cd9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:59.075229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc425f-7b03-4389-972f-956e51f0cd9f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:59.087956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 402/798] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:59.093778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a7864-671f-4908-82d0-5f00fd9c444e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:59.230338 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc425f-7b03-4389-972f-956e51f0cd9f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:59.253295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a7864-671f-4908-82d0-5f00fd9c444e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:59.293008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edcd92-77b7-4fd0-b83b-af6e754d6c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:59.293649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edcd92-77b7-4fd0-b83b-af6e754d6c71 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:59.293926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edcd92-77b7-4fd0-b83b-af6e754d6c71 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:59.294192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edcd92-77b7-4fd0-b83b-af6e754d6c71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:59.302631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edcd92-77b7-4fd0-b83b-af6e754d6c71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:59.304322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edcd92-77b7-4fd0-b83b-af6e754d6c71 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-63edcd92-77b7-4fd0-b83b-af6e754d6c71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:37:59.317151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:59.318098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:59.319409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:37:59.319409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:37:59.319409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:37:59.319409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:37:59.319409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:37:59.319409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:37:59.319409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:37:59.319409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:37:59.319409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 397/799] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:37:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:37:59.320136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d1b95-2ca1-4e98-b897-795eb17a23e3 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:59.320874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d1b95-2ca1-4e98-b897-795eb17a23e3 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:59.320874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d1b95-2ca1-4e98-b897-795eb17a23e3 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:59.322281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 398/800] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:37:59.329791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d1b95-2ca1-4e98-b897-795eb17a23e3 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:59.371775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc425f-7b03-4389-972f-956e51f0cd9f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:59.411548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:59.417807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc704b-636c-431f-99ea-2ad978a97766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:59.418709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc704b-636c-431f-99ea-2ad978a97766 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:59.419067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc704b-636c-431f-99ea-2ad978a97766 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:59.419665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc704b-636c-431f-99ea-2ad978a97766 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:59.430526 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:59.436314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc704b-636c-431f-99ea-2ad978a97766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-35fc704b-636c-431f-99ea-2ad978a97766 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:37:59.443015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:37:59.444025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:37:59.445027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:37:59.451951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 403/801] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:37:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:37:59.451951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd3dc7-afc5-4016-9e19-e901a19931f4 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:59.451951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd3dc7-afc5-4016-9e19-e901a19931f4 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:59.451951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd3dc7-afc5-4016-9e19-e901a19931f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:59.473319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e5dd3dc7-afc5-4016-9e19-e901a19931f4 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:37:59.473513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d1b95-2ca1-4e98-b897-795eb17a23e3 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:59.475242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e5dd3dc7-afc5-4016-9e19-e901a19931f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:37:59.513469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a00cdf-37b0-40f7-9e80-d0e12dc3cd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:59.514044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a00cdf-37b0-40f7-9e80-d0e12dc3cd45 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:59.514367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a00cdf-37b0-40f7-9e80-d0e12dc3cd45 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:59.514643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a00cdf-37b0-40f7-9e80-d0e12dc3cd45 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:59.515408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a00cdf-37b0-40f7-9e80-d0e12dc3cd45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:59.515640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a00cdf-37b0-40f7-9e80-d0e12dc3cd45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:59.517234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a00cdf-37b0-40f7-9e80-d0e12dc3cd45 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:59.538596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 399/802] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:37:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:59.538596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a00cdf-37b0-40f7-9e80-d0e12dc3cd45 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:59.575206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 404/803] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:37:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:37:59.576355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd3dc7-afc5-4016-9e19-e901a19931f4 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:59.701094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd3dc7-afc5-4016-9e19-e901a19931f4 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:59.736206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:59.743750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a00cdf-37b0-40f7-9e80-d0e12dc3cd45 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:37:59.754462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea8b12-c176-48e4-bd41-213a0f49f16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:59.755184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea8b12-c176-48e4-bd41-213a0f49f16a None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:59.755465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea8b12-c176-48e4-bd41-213a0f49f16a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:59.755737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea8b12-c176-48e4-bd41-213a0f49f16a None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/92bc91b8b5224bd18f79bd8ea4663d3f/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:59.758342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea8b12-c176-48e4-bd41-213a0f49f16a None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=92bc91b8b5224bd18f79bd8ea4663d3f, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:59.759865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea8b12-c176-48e4-bd41-213a0f49f16a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:59.780962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:37:59.796081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a4faa-9e8c-42fd-afb9-0f28a24022f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:37:59.796718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4faa-9e8c-42fd-afb9-0f28a24022f2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:37:59.797044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4faa-9e8c-42fd-afb9-0f28a24022f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:37:59.797324 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4faa-9e8c-42fd-afb9-0f28a24022f2 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:37:59.798001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a4faa-9e8c-42fd-afb9-0f28a24022f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:37:59.798304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a4faa-9e8c-42fd-afb9-0f28a24022f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:37:59.800025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a4faa-9e8c-42fd-afb9-0f28a24022f2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:37:59.810096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 400/804] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:37:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:37:59.815901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a4faa-9e8c-42fd-afb9-0f28a24022f2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:59.870960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 405/805] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:37:59 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/92bc91b8b5224bd18f79bd8ea4663d3f/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:37:59.932407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea8b12-c176-48e4-bd41-213a0f49f16a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:37:59.959010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a4faa-9e8c-42fd-afb9-0f28a24022f2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:00.054180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01ef48-1e0e-4680-a426-f56abe574a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:00.054852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01ef48-1e0e-4680-a426-f56abe574a41 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:00.055134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01ef48-1e0e-4680-a426-f56abe574a41 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:00.055462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01ef48-1e0e-4680-a426-f56abe574a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:00.071153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01ef48-1e0e-4680-a426-f56abe574a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:00.073963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01ef48-1e0e-4680-a426-f56abe574a41 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:00.077339 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea8b12-c176-48e4-bd41-213a0f49f16a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-8c01ef48-1e0e-4680-a426-f56abe574a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:00.095475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:00.097071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:00.098193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:00.098193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:00.098193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:00.104744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 401/806] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:00.104744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfa40e-0fe0-4a95-aac7-8b62ca1865c8 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:00.104744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfa40e-0fe0-4a95-aac7-8b62ca1865c8 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:00.104744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfa40e-0fe0-4a95-aac7-8b62ca1865c8 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:00.104744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 402/807] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:00.106221 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfa40e-0fe0-4a95-aac7-8b62ca1865c8 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:00.130478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375b01c-34d4-4d7b-91eb-31b8e940d052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:00.131232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375b01c-34d4-4d7b-91eb-31b8e940d052 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:00.131579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375b01c-34d4-4d7b-91eb-31b8e940d052 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:00.131923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375b01c-34d4-4d7b-91eb-31b8e940d052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:00.143508 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:00.147874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375b01c-34d4-4d7b-91eb-31b8e940d052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-e375b01c-34d4-4d7b-91eb-31b8e940d052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:00.154636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:00.166153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 406/808] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:37:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:00.167769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9537d64-5bd0-4bf1-84e8-5818dd4bb979 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:00.168760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9537d64-5bd0-4bf1-84e8-5818dd4bb979 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:00.168760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9537d64-5bd0-4bf1-84e8-5818dd4bb979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:00.185613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b9537d64-5bd0-4bf1-84e8-5818dd4bb979 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:00.186891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b9537d64-5bd0-4bf1-84e8-5818dd4bb979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:00.248055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfa40e-0fe0-4a95-aac7-8b62ca1865c8 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:00.256314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:00.293081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 407/809] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:00.294200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9537d64-5bd0-4bf1-84e8-5818dd4bb979 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:00.294516 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e0a07-2974-459f-8c74-39fb8a917918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:00.295127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0a07-2974-459f-8c74-39fb8a917918 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:00.295401 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0a07-2974-459f-8c74-39fb8a917918 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:00.295667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0a07-2974-459f-8c74-39fb8a917918 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:00.296308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e0a07-2974-459f-8c74-39fb8a917918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:00.296860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e0a07-2974-459f-8c74-39fb8a917918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:00.301179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e0a07-2974-459f-8c74-39fb8a917918 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:00.336836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 403/810] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:00.338550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e0a07-2974-459f-8c74-39fb8a917918 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:00.501822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9537d64-5bd0-4bf1-84e8-5818dd4bb979 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:00.517008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e0a07-2974-459f-8c74-39fb8a917918 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:00.528913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:00.560954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d2299-ad1b-4a9f-9db6-cedc30b472d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:00.561661 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d2299-ad1b-4a9f-9db6-cedc30b472d2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:00.561937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d2299-ad1b-4a9f-9db6-cedc30b472d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:00.562205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d2299-ad1b-4a9f-9db6-cedc30b472d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:00.563744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7393e04-0f2e-4e0d-b0e9-e92398c83fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:00.564466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7393e04-0f2e-4e0d-b0e9-e92398c83fb2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:00.564779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7393e04-0f2e-4e0d-b0e9-e92398c83fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:00.565050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7393e04-0f2e-4e0d-b0e9-e92398c83fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:00.565720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7393e04-0f2e-4e0d-b0e9-e92398c83fb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:00.571916 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7393e04-0f2e-4e0d-b0e9-e92398c83fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:00.571916 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7393e04-0f2e-4e0d-b0e9-e92398c83fb2 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:00.577766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 408/811] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:38:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:00.578689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d2299-ad1b-4a9f-9db6-cedc30b472d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:00.580201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d2299-ad1b-4a9f-9db6-cedc30b472d2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:00.583172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7393e04-0f2e-4e0d-b0e9-e92398c83fb2 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-171d2299-ad1b-4a9f-9db6-cedc30b472d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:00.605658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:00.606651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:00.607686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 404/812] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 15:38:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:00.608335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d2299-ad1b-4a9f-9db6-cedc30b472d2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:00.640405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:00.709555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7393e04-0f2e-4e0d-b0e9-e92398c83fb2 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:00.755120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b01bd-c762-4a29-a6ff-f0893c6a0172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:00.755752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b01bd-c762-4a29-a6ff-f0893c6a0172 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:00.756027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b01bd-c762-4a29-a6ff-f0893c6a0172 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:00.756294 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b01bd-c762-4a29-a6ff-f0893c6a0172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:00.762874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d2299-ad1b-4a9f-9db6-cedc30b472d2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:00.768612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b01bd-c762-4a29-a6ff-f0893c6a0172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:00.770057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b01bd-c762-4a29-a6ff-f0893c6a0172 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-fa9b01bd-c762-4a29-a6ff-f0893c6a0172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:00.785877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:00.788123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:00.789826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:00.789826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:00.789826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:00.789826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 409/813] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:00.789826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b01bd-c762-4a29-a6ff-f0893c6a0172 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:00.814372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4656dc-3af2-4859-8597-7b8cfa70ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:00.815019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4656dc-3af2-4859-8597-7b8cfa70ef52 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:00.815298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4656dc-3af2-4859-8597-7b8cfa70ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:00.815575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4656dc-3af2-4859-8597-7b8cfa70ef52 None admin] PATH_INFO: `/v3/services/network` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:00.816161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4656dc-3af2-4859-8597-7b8cfa70ef52 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:00.818133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4656dc-3af2-4859-8597-7b8cfa70ef52 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-2c4656dc-3af2-4859-8597-7b8cfa70ef52 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:00.831222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:00.832871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:00.834796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 405/814] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:00 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:00.836739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4656dc-3af2-4859-8597-7b8cfa70ef52 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:00.853509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:00.905745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:00.915438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b01bd-c762-4a29-a6ff-f0893c6a0172 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:00.952791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58757088-c14d-46a8-b375-3a62bedc5800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:00.953556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58757088-c14d-46a8-b375-3a62bedc5800 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:00.953913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58757088-c14d-46a8-b375-3a62bedc5800 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:00.954271 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58757088-c14d-46a8-b375-3a62bedc5800 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:00.955105 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58757088-c14d-46a8-b375-3a62bedc5800 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:00.955494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58757088-c14d-46a8-b375-3a62bedc5800 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:00.957048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58757088-c14d-46a8-b375-3a62bedc5800 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:00.977485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4656dc-3af2-4859-8597-7b8cfa70ef52 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:00.982960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 410/815] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 15:38:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:00.984001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58757088-c14d-46a8-b375-3a62bedc5800 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:01.015399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47ba36-0e6b-4138-8229-efae8bcbce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:01.016198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47ba36-0e6b-4138-8229-efae8bcbce66 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.016558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47ba36-0e6b-4138-8229-efae8bcbce66 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.016968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47ba36-0e6b-4138-8229-efae8bcbce66 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.017675 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47ba36-0e6b-4138-8229-efae8bcbce66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:01.018119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47ba36-0e6b-4138-8229-efae8bcbce66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:01.019765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47ba36-0e6b-4138-8229-efae8bcbce66 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:01.034046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 406/816] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:01.035285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47ba36-0e6b-4138-8229-efae8bcbce66 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:01.099771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58757088-c14d-46a8-b375-3a62bedc5800 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:01.128629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:01.152220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63341aa9-e619-4dcc-9463-eb2a62ba912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:01.152889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63341aa9-e619-4dcc-9463-eb2a62ba912b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.153171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63341aa9-e619-4dcc-9463-eb2a62ba912b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.153467 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63341aa9-e619-4dcc-9463-eb2a62ba912b None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.154227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63341aa9-e619-4dcc-9463-eb2a62ba912b None admin] RBAC: Adding query filter params (name=network) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:01.154536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63341aa9-e619-4dcc-9463-eb2a62ba912b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:01.156025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63341aa9-e619-4dcc-9463-eb2a62ba912b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:01.159962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47ba36-0e6b-4138-8229-efae8bcbce66 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:01.168315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 411/817] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:38:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:01.168315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b5bdd-8e66-4719-9bc4-b1223fc0fd23 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.168315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b5bdd-8e66-4719-9bc4-b1223fc0fd23 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.168315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b5bdd-8e66-4719-9bc4-b1223fc0fd23 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.171219 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 412/818] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:01.172138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b5bdd-8e66-4719-9bc4-b1223fc0fd23 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:01.191552 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:01.199185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeebf6-6f7b-48bd-8972-c460ff27f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:01.199916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeebf6-6f7b-48bd-8972-c460ff27f8dd None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.200244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeebf6-6f7b-48bd-8972-c460ff27f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.200538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeebf6-6f7b-48bd-8972-c460ff27f8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.214863 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaeebf6-6f7b-48bd-8972-c460ff27f8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:01.216463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaeebf6-6f7b-48bd-8972-c460ff27f8dd None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-baaeebf6-6f7b-48bd-8972-c460ff27f8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:01.232304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:01.233682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:01.235593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:01.235593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:01.235593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:01.239617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 407/819] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:01.240329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeebf6-6f7b-48bd-8972-c460ff27f8dd None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:01.295419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b5bdd-8e66-4719-9bc4-b1223fc0fd23 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:01.330651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185bffe-4d39-4700-918d-498671776a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:01.333475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185bffe-4d39-4700-918d-498671776a7f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.333475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185bffe-4d39-4700-918d-498671776a7f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.333475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185bffe-4d39-4700-918d-498671776a7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.340553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185bffe-4d39-4700-918d-498671776a7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:01.342283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185bffe-4d39-4700-918d-498671776a7f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-b185bffe-4d39-4700-918d-498671776a7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:01.357129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:01.358522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:01.359471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 413/820] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 15:38:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:01.360142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ce22d-06b3-4b06-8277-e9a49b46a31f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.360142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ce22d-06b3-4b06-8277-e9a49b46a31f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.360266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ce22d-06b3-4b06-8277-e9a49b46a31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.377477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeebf6-6f7b-48bd-8972-c460ff27f8dd None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:01.380459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b37ce22d-06b3-4b06-8277-e9a49b46a31f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:01.383068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b37ce22d-06b3-4b06-8277-e9a49b46a31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:01.412904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:01.423551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59615b-244b-476c-96e9-1fe688ade518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:01.424419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59615b-244b-476c-96e9-1fe688ade518 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.424722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59615b-244b-476c-96e9-1fe688ade518 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.432584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59615b-244b-476c-96e9-1fe688ade518 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.432584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59615b-244b-476c-96e9-1fe688ade518 None admin] RBAC: Adding query filter params (type=network) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:01.432584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59615b-244b-476c-96e9-1fe688ade518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:01.432584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59615b-244b-476c-96e9-1fe688ade518 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:01.438275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 408/821] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:38:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:01.438275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59615b-244b-476c-96e9-1fe688ade518 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:01.472555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 414/822] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:01.472555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ce22d-06b3-4b06-8277-e9a49b46a31f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:01.482002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:01.601818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59615b-244b-476c-96e9-1fe688ade518 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:01.611715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ce22d-06b3-4b06-8277-e9a49b46a31f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:01.649099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbf7cf-a557-449e-be9d-fcd10bb909cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:01.649928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf7cf-a557-449e-be9d-fcd10bb909cf None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.650275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf7cf-a557-449e-be9d-fcd10bb909cf None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.650619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf7cf-a557-449e-be9d-fcd10bb909cf None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.651441 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbf7cf-a557-449e-be9d-fcd10bb909cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:01.651779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf39d8-d0d9-432f-81fa-f2d5adf03711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:01.651899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbf7cf-a557-449e-be9d-fcd10bb909cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:01.652533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf39d8-d0d9-432f-81fa-f2d5adf03711 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.652896 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf39d8-d0d9-432f-81fa-f2d5adf03711 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.653227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf39d8-d0d9-432f-81fa-f2d5adf03711 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.653545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbf7cf-a557-449e-be9d-fcd10bb909cf None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:01.654079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf39d8-d0d9-432f-81fa-f2d5adf03711 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:01.654459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf39d8-d0d9-432f-81fa-f2d5adf03711 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:01.655934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf39d8-d0d9-432f-81fa-f2d5adf03711 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:01.670176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 409/823] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:01.671115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbf7cf-a557-449e-be9d-fcd10bb909cf None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:01.680867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 415/824] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 15:38:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:01.682132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf39d8-d0d9-432f-81fa-f2d5adf03711 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:01.738297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:01.755241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:01.794869 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf39d8-d0d9-432f-81fa-f2d5adf03711 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:01.797836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbf7cf-a557-449e-be9d-fcd10bb909cf None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:01.833630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535637-7e36-4316-a4f6-319cb53caf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:01.834263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535637-7e36-4316-a4f6-319cb53caf94 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.834537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535637-7e36-4316-a4f6-319cb53caf94 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.834804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b535637-7e36-4316-a4f6-319cb53caf94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.836564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f884a-edda-4d4e-bd72-de53ee6ebbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:01.837178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f884a-edda-4d4e-bd72-de53ee6ebbd1 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:01.837460 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f884a-edda-4d4e-bd72-de53ee6ebbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:01.837759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f884a-edda-4d4e-bd72-de53ee6ebbd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:01.838549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f884a-edda-4d4e-bd72-de53ee6ebbd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:01.839977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f884a-edda-4d4e-bd72-de53ee6ebbd1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:01.842655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b535637-7e36-4316-a4f6-319cb53caf94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:01.844087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b535637-7e36-4316-a4f6-319cb53caf94 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-7b535637-7e36-4316-a4f6-319cb53caf94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:01.857355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:01.863004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:01.863976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:01.863976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:01.863976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:01.863976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:01.863976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:01.863976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:01.863976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:01.863976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:01.863976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 416/825] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:01.863976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535637-7e36-4316-a4f6-319cb53caf94 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:01.931538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 410/826] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:38:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:38:01.932857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f884a-edda-4d4e-bd72-de53ee6ebbd1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:01.987818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b535637-7e36-4316-a4f6-319cb53caf94 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:02.017319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:02.035535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2335dd-1f03-451f-ba3c-1479cb962a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:02.036160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2335dd-1f03-451f-ba3c-1479cb962a60 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.036432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2335dd-1f03-451f-ba3c-1479cb962a60 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.036731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2335dd-1f03-451f-ba3c-1479cb962a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:02.072009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f884a-edda-4d4e-bd72-de53ee6ebbd1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:02.079649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:02.114776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bf792-49d5-48e1-a36f-0e3e8494c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:02.115429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bf792-49d5-48e1-a36f-0e3e8494c6ec None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.115712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bf792-49d5-48e1-a36f-0e3e8494c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.115987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bf792-49d5-48e1-a36f-0e3e8494c6ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:02.116670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bf792-49d5-48e1-a36f-0e3e8494c6ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:02.118689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bf792-49d5-48e1-a36f-0e3e8494c6ec None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:02.118802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2335dd-1f03-451f-ba3c-1479cb962a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:02.120452 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2335dd-1f03-451f-ba3c-1479cb962a60 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-920bf792-49d5-48e1-a36f-0e3e8494c6ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:02.129314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:02.143528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:02.144400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 411/827] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:38:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:02.145265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bf792-49d5-48e1-a36f-0e3e8494c6ec None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:02.224074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 417/828] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:38:02.225445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df237370-e6c8-49c8-ac08-608ed282bf94 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.225740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df237370-e6c8-49c8-ac08-608ed282bf94 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.226010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df237370-e6c8-49c8-ac08-608ed282bf94 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:02.227410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 418/829] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:02.228005 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df237370-e6c8-49c8-ac08-608ed282bf94 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:02.243709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bf792-49d5-48e1-a36f-0e3e8494c6ec None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:02.251428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:02.279194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713791ec-6bd9-4970-abab-9bdb3751cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:02.279796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713791ec-6bd9-4970-abab-9bdb3751cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.280067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713791ec-6bd9-4970-abab-9bdb3751cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.280334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713791ec-6bd9-4970-abab-9bdb3751cfd0 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:02.281047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713791ec-6bd9-4970-abab-9bdb3751cfd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:02.281349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713791ec-6bd9-4970-abab-9bdb3751cfd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:02.282754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713791ec-6bd9-4970-abab-9bdb3751cfd0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:02.294913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 412/830] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:02.295679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713791ec-6bd9-4970-abab-9bdb3751cfd0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:02.326856 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:02.336032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df237370-e6c8-49c8-ac08-608ed282bf94 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:02.369979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87084801-7573-42d9-b0f8-54c3c27000b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:02.370590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084801-7573-42d9-b0f8-54c3c27000b1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.370871 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084801-7573-42d9-b0f8-54c3c27000b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.371142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87084801-7573-42d9-b0f8-54c3c27000b1 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:02.371775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87084801-7573-42d9-b0f8-54c3c27000b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:02.372078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87084801-7573-42d9-b0f8-54c3c27000b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:02.373485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87084801-7573-42d9-b0f8-54c3c27000b1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:02.378063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 419/831] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:38:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:02.379260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5da526-de87-4a5d-8779-f1c0e471df1f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.379540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5da526-de87-4a5d-8779-f1c0e471df1f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.379812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5da526-de87-4a5d-8779-f1c0e471df1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:02.405527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-ec5da526-de87-4a5d-8779-f1c0e471df1f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:02.407162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713791ec-6bd9-4970-abab-9bdb3751cfd0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:02.407298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ec5da526-de87-4a5d-8779-f1c0e471df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:02.451315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02d315-0aaa-435c-bd73-60cf5671bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:02.451957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d315-0aaa-435c-bd73-60cf5671bda7 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.452230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d315-0aaa-435c-bd73-60cf5671bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.452500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d315-0aaa-435c-bd73-60cf5671bda7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:02.463874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02d315-0aaa-435c-bd73-60cf5671bda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:02.465383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02d315-0aaa-435c-bd73-60cf5671bda7 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-bb02d315-0aaa-435c-bd73-60cf5671bda7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:02.480604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:02.481643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:02.482551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:02.482551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:02.482551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:02.482551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 413/832] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:02.482551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02d315-0aaa-435c-bd73-60cf5671bda7 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:02.494576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 420/833] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:02.494576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5da526-de87-4a5d-8779-f1c0e471df1f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:02.503541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:02.569441 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:02.588225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02d315-0aaa-435c-bd73-60cf5671bda7 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:02.598720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5da526-de87-4a5d-8779-f1c0e471df1f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:02.635913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740570ea-0f45-4e47-9db9-32ccc44656b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:02.636862 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740570ea-0f45-4e47-9db9-32ccc44656b3 None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.637281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740570ea-0f45-4e47-9db9-32ccc44656b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.637517 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669782fe-6ac7-4ede-ad7e-ec3a3a5a9b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:02.637901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740570ea-0f45-4e47-9db9-32ccc44656b3 None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/3f087c40f6514c3a84a4131bc5585fea/roles/3713b2e0c4f04c8cad78881a656528e6` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:02.638133 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669782fe-6ac7-4ede-ad7e-ec3a3a5a9b73 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.638411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669782fe-6ac7-4ede-ad7e-ec3a3a5a9b73 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.638686 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669782fe-6ac7-4ede-ad7e-ec3a3a5a9b73 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:02.639423 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669782fe-6ac7-4ede-ad7e-ec3a3a5a9b73 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:02.639778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669782fe-6ac7-4ede-ad7e-ec3a3a5a9b73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:02.641191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669782fe-6ac7-4ede-ad7e-ec3a3a5a9b73 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:02.649832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 421/834] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:38:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:02.650658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669782fe-6ac7-4ede-ad7e-ec3a3a5a9b73 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:02.661233 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740570ea-0f45-4e47-9db9-32ccc44656b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=3f087c40f6514c3a84a4131bc5585fea, role_id=3713b2e0c4f04c8cad78881a656528e6)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:02.662776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740570ea-0f45-4e47-9db9-32ccc44656b3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:02.754753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:02.774155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 414/835] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:38:02 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/3f087c40f6514c3a84a4131bc5585fea/roles/3713b2e0c4f04c8cad78881a656528e6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:38:02.775348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740570ea-0f45-4e47-9db9-32ccc44656b3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:02.785848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669782fe-6ac7-4ede-ad7e-ec3a3a5a9b73 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:02.843324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d645ee-9f4d-443e-bf5e-741941f1073d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:02.843958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d645ee-9f4d-443e-bf5e-741941f1073d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.844241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d645ee-9f4d-443e-bf5e-741941f1073d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.844556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d645ee-9f4d-443e-bf5e-741941f1073d None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:02.845230 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d645ee-9f4d-443e-bf5e-741941f1073d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:02.845540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d645ee-9f4d-443e-bf5e-741941f1073d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:02.847842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d645ee-9f4d-443e-bf5e-741941f1073d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:02.864445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 422/836] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:02.869777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d645ee-9f4d-443e-bf5e-741941f1073d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:02.934685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740570ea-0f45-4e47-9db9-32ccc44656b3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:02.983367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:02.990075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7416b6-9787-45e9-93e3-5a89654530f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:02.991010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7416b6-9787-45e9-93e3-5a89654530f3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:02.994057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7416b6-9787-45e9-93e3-5a89654530f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:02.994057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7416b6-9787-45e9-93e3-5a89654530f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:03.006685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7416b6-9787-45e9-93e3-5a89654530f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:03.012170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d645ee-9f4d-443e-bf5e-741941f1073d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-6d7416b6-9787-45e9-93e3-5a89654530f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:03.013198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:03.014134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:38:03.014997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:03.015716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 415/837] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:03.021540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7416b6-9787-45e9-93e3-5a89654530f3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:03.058204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3225c24-8519-4c12-8616-9090061b5ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:03.059877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3225c24-8519-4c12-8616-9090061b5ed9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:03.060246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3225c24-8519-4c12-8616-9090061b5ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:03.060622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3225c24-8519-4c12-8616-9090061b5ed9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:03.069390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3225c24-8519-4c12-8616-9090061b5ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:03.071894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3225c24-8519-4c12-8616-9090061b5ed9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:03.075297 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-e3225c24-8519-4c12-8616-9090061b5ed9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:03.088385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:03.092002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:03.093160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:03.093160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:03.093160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:03.093160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:03.093160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:03.093160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:03.093160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:03.093160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:03.093160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 423/838] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:03.096068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3225c24-8519-4c12-8616-9090061b5ed9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:03.136851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7416b6-9787-45e9-93e3-5a89654530f3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:03.182181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61d3e-c1f7-4acb-a5be-c59b24ba606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:03.182941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61d3e-c1f7-4acb-a5be-c59b24ba606a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:03.183381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61d3e-c1f7-4acb-a5be-c59b24ba606a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:03.183726 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61d3e-c1f7-4acb-a5be-c59b24ba606a None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:03.184605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea61d3e-c1f7-4acb-a5be-c59b24ba606a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:03.184988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea61d3e-c1f7-4acb-a5be-c59b24ba606a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:03.186484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea61d3e-c1f7-4acb-a5be-c59b24ba606a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:03.201766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 416/839] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:38:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:03.203391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61d3e-c1f7-4acb-a5be-c59b24ba606a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:03.203624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3225c24-8519-4c12-8616-9090061b5ed9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:03.239164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790d50-3550-4ded-b51a-ead1d8508e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:03.240038 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790d50-3550-4ded-b51a-ead1d8508e38 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:03.240329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790d50-3550-4ded-b51a-ead1d8508e38 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:03.240625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790d50-3550-4ded-b51a-ead1d8508e38 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:03.241325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db790d50-3550-4ded-b51a-ead1d8508e38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:03.241627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db790d50-3550-4ded-b51a-ead1d8508e38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:03.244585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db790d50-3550-4ded-b51a-ead1d8508e38 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:03.264908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 424/840] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:38:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:03.267209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790d50-3550-4ded-b51a-ead1d8508e38 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:03.272874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:03.329245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61d3e-c1f7-4acb-a5be-c59b24ba606a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:03.338604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:03.374133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332283b-9597-4d1e-8056-6c0378ad3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:03.374801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332283b-9597-4d1e-8056-6c0378ad3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:03.375081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332283b-9597-4d1e-8056-6c0378ad3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:03.375380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332283b-9597-4d1e-8056-6c0378ad3ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:03.387853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332283b-9597-4d1e-8056-6c0378ad3ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:03.389477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332283b-9597-4d1e-8056-6c0378ad3ee5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:03.394433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790d50-3550-4ded-b51a-ead1d8508e38 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9332283b-9597-4d1e-8056-6c0378ad3ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:03.406022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:03.406992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:03.407987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:03.407987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:03.407987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:03.412267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 417/841] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:03.413742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332283b-9597-4d1e-8056-6c0378ad3ee5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:03.442099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516b81f-d5d8-4d53-9776-767bdf01d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:03.442739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516b81f-d5d8-4d53-9776-767bdf01d135 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:03.443020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516b81f-d5d8-4d53-9776-767bdf01d135 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:03.443290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516b81f-d5d8-4d53-9776-767bdf01d135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:03.444043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516b81f-d5d8-4d53-9776-767bdf01d135 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=1c12495a6cf64c80b45785f185f28383) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:03.444658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516b81f-d5d8-4d53-9776-767bdf01d135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:03.446758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516b81f-d5d8-4d53-9776-767bdf01d135 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:03.461087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 425/842] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:03 2022] GET /identity/v3/role_assignments?user.id=1c12495a6cf64c80b45785f185f28383&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=eeb6551eeb934053866fc821b511b5dd => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:03.543489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332283b-9597-4d1e-8056-6c0378ad3ee5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:03.551597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:03.583817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546031a-b2ae-4d2a-94c8-87f89855a13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:03.584715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546031a-b2ae-4d2a-94c8-87f89855a13e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:03.585135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546031a-b2ae-4d2a-94c8-87f89855a13e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:03.586275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546031a-b2ae-4d2a-94c8-87f89855a13e None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:03.587093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546031a-b2ae-4d2a-94c8-87f89855a13e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:03.587556 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546031a-b2ae-4d2a-94c8-87f89855a13e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:03.589267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1546031a-b2ae-4d2a-94c8-87f89855a13e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:03.603256 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 418/843] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:03.609177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516b81f-d5d8-4d53-9776-767bdf01d135 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:03.724136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516b81f-d5d8-4d53-9776-767bdf01d135 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:03.749102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:03.761324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076450e6-db26-4c43-ab2b-9d65f89939f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:03.761969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076450e6-db26-4c43-ab2b-9d65f89939f3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:03.762306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076450e6-db26-4c43-ab2b-9d65f89939f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:03.762581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076450e6-db26-4c43-ab2b-9d65f89939f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:03.771632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076450e6-db26-4c43-ab2b-9d65f89939f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:03.773214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076450e6-db26-4c43-ab2b-9d65f89939f3 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-076450e6-db26-4c43-ab2b-9d65f89939f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:03.786274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:03.787335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:03.788660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 426/844] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:38:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:03.796243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546031a-b2ae-4d2a-94c8-87f89855a13e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:03.930619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546031a-b2ae-4d2a-94c8-87f89855a13e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:03.969774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8688742-797f-4754-8f4e-4166afcb951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:03.970443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8688742-797f-4754-8f4e-4166afcb951e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:03.970720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8688742-797f-4754-8f4e-4166afcb951e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:03.970991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8688742-797f-4754-8f4e-4166afcb951e None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:03.971727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8688742-797f-4754-8f4e-4166afcb951e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:03.972031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8688742-797f-4754-8f4e-4166afcb951e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:03.973551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8688742-797f-4754-8f4e-4166afcb951e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:03.993870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 419/845] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 15:38:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:04.000040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076450e6-db26-4c43-ab2b-9d65f89939f3 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:04.133468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076450e6-db26-4c43-ab2b-9d65f89939f3 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:04.169230 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a2382-3941-4691-b38a-79a3e7f04419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:04.169853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a2382-3941-4691-b38a-79a3e7f04419 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:04.170134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a2382-3941-4691-b38a-79a3e7f04419 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:04.170410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a2382-3941-4691-b38a-79a3e7f04419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:04.226029 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:04.246779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a2382-3941-4691-b38a-79a3e7f04419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:04.248319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a2382-3941-4691-b38a-79a3e7f04419 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:04.358993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 427/846] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:38:04.365667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8688742-797f-4754-8f4e-4166afcb951e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:04.395130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:04.480428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8688742-797f-4754-8f4e-4166afcb951e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:04.518619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d21b5-be72-4570-a59f-3547d2b94403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:04.519270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d21b5-be72-4570-a59f-3547d2b94403 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:04.519544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d21b5-be72-4570-a59f-3547d2b94403 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:04.519815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d21b5-be72-4570-a59f-3547d2b94403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:04.530982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d21b5-be72-4570-a59f-3547d2b94403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:04.532449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d21b5-be72-4570-a59f-3547d2b94403 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-674d21b5-be72-4570-a59f-3547d2b94403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:04.548127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:04.549535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:04.550931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:04.550931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:04.550931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:04.550931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 420/847] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:04.557947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a2382-3941-4691-b38a-79a3e7f04419 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:04.646106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:04.647912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357de8e-aae9-44a0-8c2e-18b55d3f4079 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:04.648201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357de8e-aae9-44a0-8c2e-18b55d3f4079 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:04.648473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357de8e-aae9-44a0-8c2e-18b55d3f4079 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:04.650044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 421/848] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:04.656127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efb184-7737-4c71-a8ec-5b8fb5629bda None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:04.656819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efb184-7737-4c71-a8ec-5b8fb5629bda None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:04.657325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efb184-7737-4c71-a8ec-5b8fb5629bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:04.671129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a2382-3941-4691-b38a-79a3e7f04419 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:04.680426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-f6efb184-7737-4c71-a8ec-5b8fb5629bda None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:04.682176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f6efb184-7737-4c71-a8ec-5b8fb5629bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:04.717646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367802f-105c-4e1a-a7c0-42be9b4950ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:04.718563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367802f-105c-4e1a-a7c0-42be9b4950ca None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:04.718857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367802f-105c-4e1a-a7c0-42be9b4950ca None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:04.719135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367802f-105c-4e1a-a7c0-42be9b4950ca None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:04.720089 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367802f-105c-4e1a-a7c0-42be9b4950ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:04.720398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367802f-105c-4e1a-a7c0-42be9b4950ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:04.722037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367802f-105c-4e1a-a7c0-42be9b4950ca None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:04.737598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 428/849] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:04.745494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367802f-105c-4e1a-a7c0-42be9b4950ca None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:04.765369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 422/850] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:04.858868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367802f-105c-4e1a-a7c0-42be9b4950ca None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:04.895369 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d726048-a3da-41c6-890e-99a20495150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:04.896432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d726048-a3da-41c6-890e-99a20495150f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:04.897024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d726048-a3da-41c6-890e-99a20495150f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:04.897494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d726048-a3da-41c6-890e-99a20495150f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:04.905554 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d726048-a3da-41c6-890e-99a20495150f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:04.907353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d726048-a3da-41c6-890e-99a20495150f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:04.915357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f6105-28dd-493f-ae8a-9d101841dedb None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:04.915639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f6105-28dd-493f-ae8a-9d101841dedb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:04.915948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f6105-28dd-493f-ae8a-9d101841dedb None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:04.917618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 423/851] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-0d726048-a3da-41c6-890e-99a20495150f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:04.920740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:04.921877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:04.922796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:04.922796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:04.922796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:04.922796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:04.922796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:04.922796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:04.922796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:04.922796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:04.923236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4330a5-ad3f-4dd0-ac3f-5e41a96a3bb1 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:04.923236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4330a5-ad3f-4dd0-ac3f-5e41a96a3bb1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:04.923374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4330a5-ad3f-4dd0-ac3f-5e41a96a3bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:04.930101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 429/852] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:04.932952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d726048-a3da-41c6-890e-99a20495150f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:04.938577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:04.944142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:04.945513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-1d4330a5-ad3f-4dd0-ac3f-5e41a96a3bb1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:04.946786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1d4330a5-ad3f-4dd0-ac3f-5e41a96a3bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:05.029273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 424/853] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:05.063982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4330a5-ad3f-4dd0-ac3f-5e41a96a3bb1 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:05.088053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d726048-a3da-41c6-890e-99a20495150f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:05.129033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972753-c915-417e-9841-7cb9df9d7960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:05.129664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972753-c915-417e-9841-7cb9df9d7960 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:05.129945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972753-c915-417e-9841-7cb9df9d7960 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:05.130261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972753-c915-417e-9841-7cb9df9d7960 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:05.130967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f972753-c915-417e-9841-7cb9df9d7960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:05.131279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f972753-c915-417e-9841-7cb9df9d7960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:05.133334 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f972753-c915-417e-9841-7cb9df9d7960 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:05.147414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 430/854] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:05.157178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972753-c915-417e-9841-7cb9df9d7960 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:05.226796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:05.238511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4330a5-ad3f-4dd0-ac3f-5e41a96a3bb1 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:05.270504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972753-c915-417e-9841-7cb9df9d7960 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:05.286894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0d62b-9f36-4fa4-acd8-fcb249c9802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:05.287527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0d62b-9f36-4fa4-acd8-fcb249c9802c None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:05.287820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0d62b-9f36-4fa4-acd8-fcb249c9802c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:05.288046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0d62b-9f36-4fa4-acd8-fcb249c9802c None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:05.288748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0d62b-9f36-4fa4-acd8-fcb249c9802c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:05.290443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0d62b-9f36-4fa4-acd8-fcb249c9802c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:05.296400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:05.315344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e73c81-c80b-414e-be45-1c384428dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:05.316055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73c81-c80b-414e-be45-1c384428dc15 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:05.316404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73c81-c80b-414e-be45-1c384428dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:05.316792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73c81-c80b-414e-be45-1c384428dc15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:05.317585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e73c81-c80b-414e-be45-1c384428dc15 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=92bc91b8b5224bd18f79bd8ea4663d3f) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:05.317964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e73c81-c80b-414e-be45-1c384428dc15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:05.319625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e73c81-c80b-414e-be45-1c384428dc15 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:05.326327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 431/855] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:05 2022] GET /identity/v3/role_assignments?user.id=92bc91b8b5224bd18f79bd8ea4663d3f&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=eeb6551eeb934053866fc821b511b5dd => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:05.416269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 425/856] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:38:05 2022] POST /identity/v3/services => generated 251 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:38:05.515782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e73c81-c80b-414e-be45-1c384428dc15 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:05.644712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e73c81-c80b-414e-be45-1c384428dc15 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:05.673198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:05.688491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515eae3-efc2-438e-8a5b-1c1ab2d325c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:05.689202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515eae3-efc2-438e-8a5b-1c1ab2d325c1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:05.689497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515eae3-efc2-438e-8a5b-1c1ab2d325c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:05.690999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515eae3-efc2-438e-8a5b-1c1ab2d325c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:05.701906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515eae3-efc2-438e-8a5b-1c1ab2d325c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-6515eae3-efc2-438e-8a5b-1c1ab2d325c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:05.706701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:05.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:05.708632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 432/857] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:38:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:05.714687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0d62b-9f36-4fa4-acd8-fcb249c9802c None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:05.766720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1348a-b75a-4be7-92bd-888065e38a96 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:05.767001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1348a-b75a-4be7-92bd-888065e38a96 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:05.767282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1348a-b75a-4be7-92bd-888065e38a96 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:05.768988 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 433/858] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:05.774948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ea80-0473-4de5-bbce-5659f0b09d8b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:05.776912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ea80-0473-4de5-bbce-5659f0b09d8b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:05.776912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ea80-0473-4de5-bbce-5659f0b09d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:05.795695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-5d26ea80-0473-4de5-bbce-5659f0b09d8b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:05.797906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5d26ea80-0473-4de5-bbce-5659f0b09d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:05.848786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0d62b-9f36-4fa4-acd8-fcb249c9802c None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:05.900183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 434/859] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:05.900409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1db2b-5453-45d6-ac39-920b1485571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:05.901248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1db2b-5453-45d6-ac39-920b1485571b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:05.901572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1db2b-5453-45d6-ac39-920b1485571b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:05.901853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1db2b-5453-45d6-ac39-920b1485571b None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:05.902538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1db2b-5453-45d6-ac39-920b1485571b None admin] RBAC: Adding query filter params (name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:05.902842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1db2b-5453-45d6-ac39-920b1485571b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:05.904227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1db2b-5453-45d6-ac39-920b1485571b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:05.913758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 426/860] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:38:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:05.919332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26ea80-0473-4de5-bbce-5659f0b09d8b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:06.032022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26ea80-0473-4de5-bbce-5659f0b09d8b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:06.046288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:06.069068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44323-3353-450a-8613-cf205112b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:06.070695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44323-3353-450a-8613-cf205112b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:06.071196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44323-3353-450a-8613-cf205112b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:06.071671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e44323-3353-450a-8613-cf205112b8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:06.082306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44323-3353-450a-8613-cf205112b8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:06.084079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e44323-3353-450a-8613-cf205112b8e1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-27e44323-3353-450a-8613-cf205112b8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:06.100353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:06.101490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:06.102748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:06.102748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:06.102748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:06.105597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 435/861] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:06.113985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1db2b-5453-45d6-ac39-920b1485571b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:06.177405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:06.219351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44323-3353-450a-8613-cf205112b8e1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:06.232031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1db2b-5453-45d6-ac39-920b1485571b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:06.270832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e12c1a-9d27-45e8-af71-d76cee91c336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:06.271450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e12c1a-9d27-45e8-af71-d76cee91c336 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:06.271730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e12c1a-9d27-45e8-af71-d76cee91c336 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:06.272002 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e12c1a-9d27-45e8-af71-d76cee91c336 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:06.272673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e12c1a-9d27-45e8-af71-d76cee91c336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:06.273008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e12c1a-9d27-45e8-af71-d76cee91c336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:06.274433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e12c1a-9d27-45e8-af71-d76cee91c336 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:06.292782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 427/862] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:06.293963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e12c1a-9d27-45e8-af71-d76cee91c336 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:06.350506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e44323-3353-450a-8613-cf205112b8e1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:06.389486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd683e-4e35-46e0-9ea2-7d1cd2d0a13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:06.390538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd683e-4e35-46e0-9ea2-7d1cd2d0a13c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:06.391028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd683e-4e35-46e0-9ea2-7d1cd2d0a13c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:06.391522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd683e-4e35-46e0-9ea2-7d1cd2d0a13c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:06.392307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd683e-4e35-46e0-9ea2-7d1cd2d0a13c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:06.393919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd683e-4e35-46e0-9ea2-7d1cd2d0a13c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-26bd683e-4e35-46e0-9ea2-7d1cd2d0a13c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:06.403759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:06.405099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:38:06.406057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:06.408859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 436/863] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Aug 22 15:38:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:06.414836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd683e-4e35-46e0-9ea2-7d1cd2d0a13c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:06.437522 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e12c1a-9d27-45e8-af71-d76cee91c336 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:06.451379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:06.460858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:06.479722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549d7a5-8a64-40ef-b13b-bc1adc2472b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:06.480803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549d7a5-8a64-40ef-b13b-bc1adc2472b5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:06.481286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549d7a5-8a64-40ef-b13b-bc1adc2472b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:06.481779 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549d7a5-8a64-40ef-b13b-bc1adc2472b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:06.490176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549d7a5-8a64-40ef-b13b-bc1adc2472b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:06.492684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549d7a5-8a64-40ef-b13b-bc1adc2472b5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-c549d7a5-8a64-40ef-b13b-bc1adc2472b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:06.507004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:06.508338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:06.509352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:06.509352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:06.509352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:06.509352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:06.509352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:06.509352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:06.509352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:06.509352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:06.509352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:38:06.509352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:06.516536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 428/864] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 15:38:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:06.517902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549d7a5-8a64-40ef-b13b-bc1adc2472b5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:06.562880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd683e-4e35-46e0-9ea2-7d1cd2d0a13c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:06.614142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cbdb7-b7c6-41a9-9042-4159ffdbe81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:06.614771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cbdb7-b7c6-41a9-9042-4159ffdbe81d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:06.615053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cbdb7-b7c6-41a9-9042-4159ffdbe81d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:06.615329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cbdb7-b7c6-41a9-9042-4159ffdbe81d None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:06.615968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cbdb7-b7c6-41a9-9042-4159ffdbe81d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:06.616647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cbdb7-b7c6-41a9-9042-4159ffdbe81d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:06.618392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cbdb7-b7c6-41a9-9042-4159ffdbe81d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:06.628889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 437/865] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:06.633993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cbdb7-b7c6-41a9-9042-4159ffdbe81d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:06.653855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549d7a5-8a64-40ef-b13b-bc1adc2472b5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:06.694233 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaf1d8-4b43-4e7c-8ce3-9f30720b90ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:06.695258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaf1d8-4b43-4e7c-8ce3-9f30720b90ad None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:06.695763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaf1d8-4b43-4e7c-8ce3-9f30720b90ad None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:06.696268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeaf1d8-4b43-4e7c-8ce3-9f30720b90ad None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:06.697318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaf1d8-4b43-4e7c-8ce3-9f30720b90ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:06.698032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaf1d8-4b43-4e7c-8ce3-9f30720b90ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:06.699680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeaf1d8-4b43-4e7c-8ce3-9f30720b90ad None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:06.724578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 429/866] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 15:38:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:06.727302 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaf1d8-4b43-4e7c-8ce3-9f30720b90ad None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:06.748977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:06.754845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cbdb7-b7c6-41a9-9042-4159ffdbe81d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:06.768402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:06.795560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f68fe-f2a8-426b-8ed7-c94c665e17aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:06.796423 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f68fe-f2a8-426b-8ed7-c94c665e17aa None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:06.796908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f68fe-f2a8-426b-8ed7-c94c665e17aa None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:06.797330 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f68fe-f2a8-426b-8ed7-c94c665e17aa None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:06.798112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f68fe-f2a8-426b-8ed7-c94c665e17aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:06.798565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f68fe-f2a8-426b-8ed7-c94c665e17aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:06.800336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f68fe-f2a8-426b-8ed7-c94c665e17aa None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:06.806064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 438/867] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:06.851014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeaf1d8-4b43-4e7c-8ce3-9f30720b90ad None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:06.889652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe236-c927-4fee-96a1-1686285f53b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:06.890704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe236-c927-4fee-96a1-1686285f53b3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:06.891244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe236-c927-4fee-96a1-1686285f53b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:06.891847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe236-c927-4fee-96a1-1686285f53b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:06.978786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbe236-c927-4fee-96a1-1686285f53b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:06.980267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbe236-c927-4fee-96a1-1686285f53b3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:07.022395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:07.099861 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 430/868] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:06 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:38:07.106486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f68fe-f2a8-426b-8ed7-c94c665e17aa None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:07.260870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f68fe-f2a8-426b-8ed7-c94c665e17aa None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:07.297149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89099e-4afd-4636-b9e4-eca779d3dd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:07.297764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89099e-4afd-4636-b9e4-eca779d3dd05 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:07.298051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89099e-4afd-4636-b9e4-eca779d3dd05 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:07.298330 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89099e-4afd-4636-b9e4-eca779d3dd05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:07.309655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89099e-4afd-4636-b9e4-eca779d3dd05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:07.311169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89099e-4afd-4636-b9e4-eca779d3dd05 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-0f89099e-4afd-4636-b9e4-eca779d3dd05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:07.326735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:07.327734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:07.328745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:07.328745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:07.328745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:07.328745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 439/869] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:07.335176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe236-c927-4fee-96a1-1686285f53b3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:07.446133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe236-c927-4fee-96a1-1686285f53b3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:07.484072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb49c0a-ba66-41dc-bf73-e3151fbb9164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:07.484733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb49c0a-ba66-41dc-bf73-e3151fbb9164 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:07.485015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb49c0a-ba66-41dc-bf73-e3151fbb9164 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:07.485287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb49c0a-ba66-41dc-bf73-e3151fbb9164 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:07.485938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb49c0a-ba66-41dc-bf73-e3151fbb9164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:07.486246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb49c0a-ba66-41dc-bf73-e3151fbb9164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:07.487625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb49c0a-ba66-41dc-bf73-e3151fbb9164 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:07.490347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:07.495054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696b18-6e74-4709-ad4b-57afc9c88248 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:07.496300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696b18-6e74-4709-ad4b-57afc9c88248 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:07.496300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64696b18-6e74-4709-ad4b-57afc9c88248 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:07.508192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 440/870] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:07.508192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5c929-9b4f-4e66-bb0d-5506bef5209c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:07.508192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5c929-9b4f-4e66-bb0d-5506bef5209c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:07.508192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5c929-9b4f-4e66-bb0d-5506bef5209c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:07.508752 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 431/871] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:07.517570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb49c0a-ba66-41dc-bf73-e3151fbb9164 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:07.532109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-95d5c929-9b4f-4e66-bb0d-5506bef5209c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:07.533520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-95d5c929-9b4f-4e66-bb0d-5506bef5209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:07.535661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:07.606378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 441/872] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:07.607382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b1981-8942-4749-b724-9afde88d48b3 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:07.607747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b1981-8942-4749-b724-9afde88d48b3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:07.607951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b1981-8942-4749-b724-9afde88d48b3 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:07.609399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 442/873] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:07.614669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98c44-f04f-4b65-902b-d18fd2d0f06f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:07.614946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98c44-f04f-4b65-902b-d18fd2d0f06f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:07.615215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98c44-f04f-4b65-902b-d18fd2d0f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:07.641483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-78f98c44-f04f-4b65-902b-d18fd2d0f06f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:07.642973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-78f98c44-f04f-4b65-902b-d18fd2d0f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:07.655200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb49c0a-ba66-41dc-bf73-e3151fbb9164 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:07.692385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5507f05-3ef9-4866-9ab0-2e6ee25da0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:07.693057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5507f05-3ef9-4866-9ab0-2e6ee25da0a5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:07.693331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5507f05-3ef9-4866-9ab0-2e6ee25da0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:07.693594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5507f05-3ef9-4866-9ab0-2e6ee25da0a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:07.702043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5507f05-3ef9-4866-9ab0-2e6ee25da0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:07.703550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5507f05-3ef9-4866-9ab0-2e6ee25da0a5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-d5507f05-3ef9-4866-9ab0-2e6ee25da0a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:07.715795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:07.716785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:07.717690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:07.717690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:07.717690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:07.717690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:07.717690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:07.717690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:07.717690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:07.717690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:07.717690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 432/874] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:07.725687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5507f05-3ef9-4866-9ab0-2e6ee25da0a5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:07.732613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 443/875] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:07.793942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:07.846264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5507f05-3ef9-4866-9ab0-2e6ee25da0a5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:07.883012 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef116da-6f4c-4ffd-9ca8-8b6157bc66a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:07.883992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef116da-6f4c-4ffd-9ca8-8b6157bc66a7 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:07.884422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef116da-6f4c-4ffd-9ca8-8b6157bc66a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:07.884886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef116da-6f4c-4ffd-9ca8-8b6157bc66a7 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:07.885725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef116da-6f4c-4ffd-9ca8-8b6157bc66a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:07.886381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef116da-6f4c-4ffd-9ca8-8b6157bc66a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:07.888110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef116da-6f4c-4ffd-9ca8-8b6157bc66a7 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:07.907010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 433/876] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:07.910752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f98c44-f04f-4b65-902b-d18fd2d0f06f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:07.913849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef116da-6f4c-4ffd-9ca8-8b6157bc66a7 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:07.999642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:08.035135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f98c44-f04f-4b65-902b-d18fd2d0f06f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:08.063905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef116da-6f4c-4ffd-9ca8-8b6157bc66a7 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:08.076935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f4522-6df6-47c6-9b4f-bc35d297aed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:08.077805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4522-6df6-47c6-9b4f-bc35d297aed9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:08.078275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4522-6df6-47c6-9b4f-bc35d297aed9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:08.078792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4522-6df6-47c6-9b4f-bc35d297aed9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:08.079650 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f4522-6df6-47c6-9b4f-bc35d297aed9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:08.081106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f4522-6df6-47c6-9b4f-bc35d297aed9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:08.082082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-a59f4522-6df6-47c6-9b4f-bc35d297aed9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:08.091511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:08.093405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:08.094265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 444/877] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:08.095066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f4522-6df6-47c6-9b4f-bc35d297aed9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:08.104179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01599f0-32e4-4f58-a5dd-52a7e93b86e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:08.104826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01599f0-32e4-4f58-a5dd-52a7e93b86e0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:08.105139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01599f0-32e4-4f58-a5dd-52a7e93b86e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:08.105404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01599f0-32e4-4f58-a5dd-52a7e93b86e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:08.106131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01599f0-32e4-4f58-a5dd-52a7e93b86e0 None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=3f087c40f6514c3a84a4131bc5585fea) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:08.106436 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01599f0-32e4-4f58-a5dd-52a7e93b86e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:08.107887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01599f0-32e4-4f58-a5dd-52a7e93b86e0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:08.124803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 434/878] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:07 2022] GET /identity/v3/role_assignments?user.id=3f087c40f6514c3a84a4131bc5585fea&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:08.124803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01599f0-32e4-4f58-a5dd-52a7e93b86e0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:08.245904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f4522-6df6-47c6-9b4f-bc35d297aed9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:08.258138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01599f0-32e4-4f58-a5dd-52a7e93b86e0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:08.287434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:08.294766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d28ec4-90c9-468e-8adf-c4359c2a627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:08.296109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d28ec4-90c9-468e-8adf-c4359c2a627d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:08.296582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d28ec4-90c9-468e-8adf-c4359c2a627d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:08.305134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d28ec4-90c9-468e-8adf-c4359c2a627d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:08.305134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d28ec4-90c9-468e-8adf-c4359c2a627d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:08.305134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d28ec4-90c9-468e-8adf-c4359c2a627d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:08.305388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1499-64ca-4dd8-a31f-087402f540d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:08.305744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1499-64ca-4dd8-a31f-087402f540d1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:08.306019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1499-64ca-4dd8-a31f-087402f540d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:08.306290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1499-64ca-4dd8-a31f-087402f540d1 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:08.306926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f1499-64ca-4dd8-a31f-087402f540d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:08.307227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f1499-64ca-4dd8-a31f-087402f540d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:08.310287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f1499-64ca-4dd8-a31f-087402f540d1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-93d28ec4-90c9-468e-8adf-c4359c2a627d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:08.311571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:08.312655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:08.313540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 445/879] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:38:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:08.318243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d28ec4-90c9-468e-8adf-c4359c2a627d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:08.324960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 435/880] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 15:38:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:08.334642 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1499-64ca-4dd8-a31f-087402f540d1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:08.414876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:08.473960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d28ec4-90c9-468e-8adf-c4359c2a627d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:08.484745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1499-64ca-4dd8-a31f-087402f540d1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:08.520628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4b16c-1819-4a96-8d96-173712748297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:08.520628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4b16c-1819-4a96-8d96-173712748297 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:08.520628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4b16c-1819-4a96-8d96-173712748297 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:08.520628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4b16c-1819-4a96-8d96-173712748297 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:08.521350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4b16c-1819-4a96-8d96-173712748297 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:08.521350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4b16c-1819-4a96-8d96-173712748297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:08.524601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4b16c-1819-4a96-8d96-173712748297 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:08.527841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 446/881] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:38:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:08.530041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080e37e-3db7-4ac0-a2b1-ed2f2e623a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:08.530660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080e37e-3db7-4ac0-a2b1-ed2f2e623a69 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:08.530937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080e37e-3db7-4ac0-a2b1-ed2f2e623a69 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:08.531202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080e37e-3db7-4ac0-a2b1-ed2f2e623a69 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:08.531931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080e37e-3db7-4ac0-a2b1-ed2f2e623a69 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:08.532232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080e37e-3db7-4ac0-a2b1-ed2f2e623a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:08.533258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4b16c-1819-4a96-8d96-173712748297 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:08.535385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080e37e-3db7-4ac0-a2b1-ed2f2e623a69 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:08.541366 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 436/882] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 15:38:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:08.614134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:08.664426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4b16c-1819-4a96-8d96-173712748297 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:08.704445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d74e5c-d58c-4896-b8c6-43075b7e5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:08.705543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74e5c-d58c-4896-b8c6-43075b7e5979 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:08.706045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74e5c-d58c-4896-b8c6-43075b7e5979 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:08.706607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74e5c-d58c-4896-b8c6-43075b7e5979 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:08.707451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74e5c-d58c-4896-b8c6-43075b7e5979 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:08.707751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74e5c-d58c-4896-b8c6-43075b7e5979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:08.709146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74e5c-d58c-4896-b8c6-43075b7e5979 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:08.714978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 447/883] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:38:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:08.720895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080e37e-3db7-4ac0-a2b1-ed2f2e623a69 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:08.834068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080e37e-3db7-4ac0-a2b1-ed2f2e623a69 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:08.844168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:08.874297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c79f4-7a9c-4e1c-8744-a3ec61a01e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:08.874297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c79f4-7a9c-4e1c-8744-a3ec61a01e28 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:08.874297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c79f4-7a9c-4e1c-8744-a3ec61a01e28 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:08.874297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c79f4-7a9c-4e1c-8744-a3ec61a01e28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:08.874716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c79f4-7a9c-4e1c-8744-a3ec61a01e28 None admin] RBAC: Adding query filter params (interface=public, service_id=1e5380ce86a24a1abfd2cac1463dc359, region_id=RegionOne) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:08.874716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c79f4-7a9c-4e1c-8744-a3ec61a01e28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:08.875647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c79f4-7a9c-4e1c-8744-a3ec61a01e28 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:08.881587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 437/884] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 15:38:08 2022] GET /identity/v3/endpoints?service_id=1e5380ce86a24a1abfd2cac1463dc359&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:08.886884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d74e5c-d58c-4896-b8c6-43075b7e5979 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:08.940072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664376c-b359-4024-92e0-4a2f777ec50e None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:08.940272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664376c-b359-4024-92e0-4a2f777ec50e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:08.940712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664376c-b359-4024-92e0-4a2f777ec50e None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:08.942370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 438/885] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:08.947730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f196a-1f3f-4f43-bb91-535cae7b0ea4 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:08.948011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f196a-1f3f-4f43-bb91-535cae7b0ea4 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:08.948281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f196a-1f3f-4f43-bb91-535cae7b0ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:08.969386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-153f196a-1f3f-4f43-bb91-535cae7b0ea4 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:08.970836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-153f196a-1f3f-4f43-bb91-535cae7b0ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:09.014349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d74e5c-d58c-4896-b8c6-43075b7e5979 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:09.041490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:09.052219 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 439/886] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:09.062321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd48a47-c0d3-4c61-83b4-91fed7e0d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:09.062949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd48a47-c0d3-4c61-83b4-91fed7e0d9be None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:09.063227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd48a47-c0d3-4c61-83b4-91fed7e0d9be None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:09.063494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd48a47-c0d3-4c61-83b4-91fed7e0d9be None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:09.064109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd48a47-c0d3-4c61-83b4-91fed7e0d9be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:09.065603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd48a47-c0d3-4c61-83b4-91fed7e0d9be None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:09.071812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 448/887] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 15:38:08 2022] GET /identity/v3/services => generated 1011 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:38:09.334717 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f196a-1f3f-4f43-bb91-535cae7b0ea4 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:09.446273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f196a-1f3f-4f43-bb91-535cae7b0ea4 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:09.448274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:09.483103 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf8e05-79e9-49bc-9336-f35d6fbf1a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:09.483718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8e05-79e9-49bc-9336-f35d6fbf1a9e None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:09.484149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8e05-79e9-49bc-9336-f35d6fbf1a9e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:09.484468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf8e05-79e9-49bc-9336-f35d6fbf1a9e None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:09.485167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf8e05-79e9-49bc-9336-f35d6fbf1a9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:09.486777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf8e05-79e9-49bc-9336-f35d6fbf1a9e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:09.585534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 440/888] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:38:09 2022] POST /identity/v3/services => generated 269 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:38:10.300756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29962049-c132-46bb-b480-40a95bec5373 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:10.301301 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29962049-c132-46bb-b480-40a95bec5373 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:10.301301 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29962049-c132-46bb-b480-40a95bec5373 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:10.303031 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 449/889] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:10.308479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fed366-ca9b-4be7-8441-f72783607b07 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:10.308798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fed366-ca9b-4be7-8441-f72783607b07 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:10.309071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fed366-ca9b-4be7-8441-f72783607b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:10.328079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e8fed366-ca9b-4be7-8441-f72783607b07 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:10.329317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e8fed366-ca9b-4be7-8441-f72783607b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:10.412637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 441/890] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:10.564595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e2b4-53b8-4ae8-923c-4e4d0e8b6172 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:10.564788 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e2b4-53b8-4ae8-923c-4e4d0e8b6172 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:10.565048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e2b4-53b8-4ae8-923c-4e4d0e8b6172 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:10.566623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 450/891] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:10.572452 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005478b9-bef5-4243-afb0-73d975bba7f9 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:10.572951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005478b9-bef5-4243-afb0-73d975bba7f9 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:10.573027 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005478b9-bef5-4243-afb0-73d975bba7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:10.592723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-005478b9-bef5-4243-afb0-73d975bba7f9 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:10.593953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-005478b9-bef5-4243-afb0-73d975bba7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:10.667748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 442/892] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:10.697113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e2b4-53b8-4ae8-923c-4e4d0e8b6172 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:10.808225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e2b4-53b8-4ae8-923c-4e4d0e8b6172 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:10.844192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c6f92-1ead-4589-8e28-dbd3c9786d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:10.844786 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c6f92-1ead-4589-8e28-dbd3c9786d68 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:10.845066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c6f92-1ead-4589-8e28-dbd3c9786d68 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:10.845336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c6f92-1ead-4589-8e28-dbd3c9786d68 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:10.856747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c6f92-1ead-4589-8e28-dbd3c9786d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-660c6f92-1ead-4589-8e28-dbd3c9786d68 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:10.861494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:10.862437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:10.863300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 451/893] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 15:38:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:10.868797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005478b9-bef5-4243-afb0-73d975bba7f9 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:10.890451 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:10.968036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c6f92-1ead-4589-8e28-dbd3c9786d68 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:10.981402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005478b9-bef5-4243-afb0-73d975bba7f9 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:11.020204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b836b-cbdb-4126-b03c-492226be4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:11.020851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b836b-cbdb-4126-b03c-492226be4196 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.021136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b836b-cbdb-4126-b03c-492226be4196 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.021413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b836b-cbdb-4126-b03c-492226be4196 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.022085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b836b-cbdb-4126-b03c-492226be4196 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:11.022393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b836b-cbdb-4126-b03c-492226be4196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:11.024209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b836b-cbdb-4126-b03c-492226be4196 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:11.033278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:11.034871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 443/894] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 15:38:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:11.040728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b836b-cbdb-4126-b03c-492226be4196 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:11.100587 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c6f92-1ead-4589-8e28-dbd3c9786d68 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:11.140256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151eca2-2a2c-4bd5-853a-4560ed723635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:11.141172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151eca2-2a2c-4bd5-853a-4560ed723635 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.141458 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151eca2-2a2c-4bd5-853a-4560ed723635 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.141732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151eca2-2a2c-4bd5-853a-4560ed723635 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.142505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:11.142613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151eca2-2a2c-4bd5-853a-4560ed723635 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:11.144306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151eca2-2a2c-4bd5-853a-4560ed723635 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:11.161694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b836b-cbdb-4126-b03c-492226be4196 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:11.195750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f3230-6991-434d-839a-1e85ef6ba6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:11.196420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f3230-6991-434d-839a-1e85ef6ba6b5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.196727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f3230-6991-434d-839a-1e85ef6ba6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.196996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f3230-6991-434d-839a-1e85ef6ba6b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.207860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f3230-6991-434d-839a-1e85ef6ba6b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:11.209330 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f3230-6991-434d-839a-1e85ef6ba6b5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:11.223954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 452/895] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:38:10 2022] POST /identity/v3/services => generated 241 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-8d2f3230-6991-434d-839a-1e85ef6ba6b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:11.224260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:11.225338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:11.234614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:11.234614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:11.234614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:11.234614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 444/896] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:11.234614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f3230-6991-434d-839a-1e85ef6ba6b5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:11.234919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23cc45-48c7-42ee-b114-a5d8788a5ab2 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.234919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23cc45-48c7-42ee-b114-a5d8788a5ab2 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.234919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23cc45-48c7-42ee-b114-a5d8788a5ab2 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.241053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 453/897] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:11.243377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e05d0-1bb8-4341-a28e-d1c6fec8544a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.243743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e05d0-1bb8-4341-a28e-d1c6fec8544a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.243864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e05d0-1bb8-4341-a28e-d1c6fec8544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.265674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e99e05d0-1bb8-4341-a28e-d1c6fec8544a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:11.266990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e99e05d0-1bb8-4341-a28e-d1c6fec8544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:11.367376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 454/898] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:11.387508 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f3230-6991-434d-839a-1e85ef6ba6b5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:11.422369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:11.427266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21121f-28ea-4505-9cac-67bcec46c983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:11.427871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21121f-28ea-4505-9cac-67bcec46c983 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.428144 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21121f-28ea-4505-9cac-67bcec46c983 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.428413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21121f-28ea-4505-9cac-67bcec46c983 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.429620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21121f-28ea-4505-9cac-67bcec46c983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:11.429922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21121f-28ea-4505-9cac-67bcec46c983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:11.431279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21121f-28ea-4505-9cac-67bcec46c983 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:11.444025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 445/899] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:11.450233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e05d0-1bb8-4341-a28e-d1c6fec8544a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:11.486683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:11.560085 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e05d0-1bb8-4341-a28e-d1c6fec8544a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:11.599917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf9805-1089-4a24-aab4-a064ea3440a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:11.601466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9805-1089-4a24-aab4-a064ea3440a4 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.601973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9805-1089-4a24-aab4-a064ea3440a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.602436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf9805-1089-4a24-aab4-a064ea3440a4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.610812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf9805-1089-4a24-aab4-a064ea3440a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:11.612699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf9805-1089-4a24-aab4-a064ea3440a4 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-c9cf9805-1089-4a24-aab4-a064ea3440a4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:11.625809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:11.626771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:11.627752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:11.627752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:11.627752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:11.627752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:11.627752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:11.627752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:11.627752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:11.627752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:11.627752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:38:11.627752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:11.629966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62ba2-8e78-48eb-b5f7-308f6d3e9f4d None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.630424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62ba2-8e78-48eb-b5f7-308f6d3e9f4d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.630502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62ba2-8e78-48eb-b5f7-308f6d3e9f4d None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.631974 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 446/900] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:11.633367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 455/901] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 15:38:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:11.638705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824ea39-928a-48bb-9d29-065787a2a303 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.639091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824ea39-928a-48bb-9d29-065787a2a303 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.639376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824ea39-928a-48bb-9d29-065787a2a303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.641475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf9805-1089-4a24-aab4-a064ea3440a4 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:11.657895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4824ea39-928a-48bb-9d29-065787a2a303 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:11.659110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4824ea39-928a-48bb-9d29-065787a2a303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:11.746655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:11.749835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 447/902] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:11.750640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824ea39-928a-48bb-9d29-065787a2a303 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:11.753687 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf9805-1089-4a24-aab4-a064ea3440a4 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:11.802136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45aaa-b8c2-4bf2-ad83-be4ba6271f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:11.802847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45aaa-b8c2-4bf2-ad83-be4ba6271f62 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.803192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45aaa-b8c2-4bf2-ad83-be4ba6271f62 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.803554 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45aaa-b8c2-4bf2-ad83-be4ba6271f62 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.804992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba45aaa-b8c2-4bf2-ad83-be4ba6271f62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:11.806048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba45aaa-b8c2-4bf2-ad83-be4ba6271f62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:11.807493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba45aaa-b8c2-4bf2-ad83-be4ba6271f62 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:11.832486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 456/903] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 15:38:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:11.837830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45aaa-b8c2-4bf2-ad83-be4ba6271f62 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:11.871855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824ea39-928a-48bb-9d29-065787a2a303 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:11.896247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:11.908940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d859d-708e-44f5-9f64-f2c9562ee82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:11.909840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d859d-708e-44f5-9f64-f2c9562ee82c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:11.910300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d859d-708e-44f5-9f64-f2c9562ee82c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:11.910794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d859d-708e-44f5-9f64-f2c9562ee82c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:11.911636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d859d-708e-44f5-9f64-f2c9562ee82c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:11.913720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d859d-708e-44f5-9f64-f2c9562ee82c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-bf1d859d-708e-44f5-9f64-f2c9562ee82c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:11.923288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:11.924782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:38:11.925652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:11.928557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 448/904] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:38:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:11.941541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d859d-708e-44f5-9f64-f2c9562ee82c None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:11.966195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45aaa-b8c2-4bf2-ad83-be4ba6271f62 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:12.013895 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa992f6-3a20-4c13-b2cd-272653b5f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:12.015015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa992f6-3a20-4c13-b2cd-272653b5f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:12.015511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa992f6-3a20-4c13-b2cd-272653b5f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:12.016014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa992f6-3a20-4c13-b2cd-272653b5f9d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:12.040705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:12.072114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d859d-708e-44f5-9f64-f2c9562ee82c None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:12.089747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa992f6-3a20-4c13-b2cd-272653b5f9d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:12.091925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa992f6-3a20-4c13-b2cd-272653b5f9d1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:12.119002 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b60e-6246-4e4b-ac0a-0fdb33a50d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:12.119643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b60e-6246-4e4b-ac0a-0fdb33a50d5f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:12.119924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b60e-6246-4e4b-ac0a-0fdb33a50d5f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:12.120200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b60e-6246-4e4b-ac0a-0fdb33a50d5f None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:12.120864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95b60e-6246-4e4b-ac0a-0fdb33a50d5f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:12.121169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95b60e-6246-4e4b-ac0a-0fdb33a50d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:12.122539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95b60e-6246-4e4b-ac0a-0fdb33a50d5f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:12.127361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 449/905] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:38:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:12.128165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b60e-6246-4e4b-ac0a-0fdb33a50d5f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:12.191623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:12.217188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 457/906] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:11 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:38:12.218075 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa992f6-3a20-4c13-b2cd-272653b5f9d1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:12.257147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b60e-6246-4e4b-ac0a-0fdb33a50d5f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:12.283068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:12.307006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c5a44-f539-438a-9b21-0175a681b726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:12.307813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5a44-f539-438a-9b21-0175a681b726 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:12.308065 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5a44-f539-438a-9b21-0175a681b726 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:12.308325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c5a44-f539-438a-9b21-0175a681b726 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:12.308963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c5a44-f539-438a-9b21-0175a681b726 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:12.310427 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c5a44-f539-438a-9b21-0175a681b726 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9c5c5a44-f539-438a-9b21-0175a681b726 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:12.322922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:12.323906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:12.324984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 450/907] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Aug 22 15:38:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:12.325801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c5a44-f539-438a-9b21-0175a681b726 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:12.344985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa992f6-3a20-4c13-b2cd-272653b5f9d1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:12.383457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54762567-03dc-4df0-8d0c-2505622e21ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:12.384101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54762567-03dc-4df0-8d0c-2505622e21ed None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:12.384383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54762567-03dc-4df0-8d0c-2505622e21ed None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:12.385019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54762567-03dc-4df0-8d0c-2505622e21ed None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:12.385661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54762567-03dc-4df0-8d0c-2505622e21ed None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:12.385976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54762567-03dc-4df0-8d0c-2505622e21ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:12.387783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54762567-03dc-4df0-8d0c-2505622e21ed None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:12.393026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 458/908] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 15:38:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:12.399099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54762567-03dc-4df0-8d0c-2505622e21ed None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:12.453689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c5a44-f539-438a-9b21-0175a681b726 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:12.470395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:12.491632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bfab6-8241-41f7-aceb-168a43cf5724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:12.492392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bfab6-8241-41f7-aceb-168a43cf5724 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:12.492699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bfab6-8241-41f7-aceb-168a43cf5724 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:12.492973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bfab6-8241-41f7-aceb-168a43cf5724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:12.505190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bfab6-8241-41f7-aceb-168a43cf5724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:12.506786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bfab6-8241-41f7-aceb-168a43cf5724 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:12.514724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54762567-03dc-4df0-8d0c-2505622e21ed None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-2d6bfab6-8241-41f7-aceb-168a43cf5724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:12.524101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:12.525275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:12.526202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:12.526202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:12.526202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:12.528340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 451/909] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:12.529139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bfab6-8241-41f7-aceb-168a43cf5724 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:12.540739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:12.561515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b79d6-9b1a-4b69-aad2-6012008c7d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:12.562131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b79d6-9b1a-4b69-aad2-6012008c7d6e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:12.562416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b79d6-9b1a-4b69-aad2-6012008c7d6e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:12.562680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b79d6-9b1a-4b69-aad2-6012008c7d6e None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:12.563356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b79d6-9b1a-4b69-aad2-6012008c7d6e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:12.564672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b79d6-9b1a-4b69-aad2-6012008c7d6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:12.565648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b79d6-9b1a-4b69-aad2-6012008c7d6e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:12.571337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 459/910] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:12.572236 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b79d6-9b1a-4b69-aad2-6012008c7d6e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:12.659242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bfab6-8241-41f7-aceb-168a43cf5724 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:12.686618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b79d6-9b1a-4b69-aad2-6012008c7d6e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:12.697860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79c26-39df-4dd8-888f-604c90344fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:12.698475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79c26-39df-4dd8-888f-604c90344fa4 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:12.698754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79c26-39df-4dd8-888f-604c90344fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:12.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79c26-39df-4dd8-888f-604c90344fa4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:12.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79c26-39df-4dd8-888f-604c90344fa4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:12.701880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79c26-39df-4dd8-888f-604c90344fa4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:12.721934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac20d6-a768-4113-b188-e4e0f8adda0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:12.722522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac20d6-a768-4113-b188-e4e0f8adda0c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:12.722801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac20d6-a768-4113-b188-e4e0f8adda0c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:12.723068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac20d6-a768-4113-b188-e4e0f8adda0c None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:12.723708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac20d6-a768-4113-b188-e4e0f8adda0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:12.724004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac20d6-a768-4113-b188-e4e0f8adda0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:12.725438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac20d6-a768-4113-b188-e4e0f8adda0c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:12.737363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 460/911] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:12.738168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac20d6-a768-4113-b188-e4e0f8adda0c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:12.781454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:12.838452 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac20d6-a768-4113-b188-e4e0f8adda0c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:12.854059 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 452/912] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:38:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:38:12.864820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79c26-39df-4dd8-888f-604c90344fa4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:12.887511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:12.898507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c371a6-1419-47bb-b96d-32c8f940dce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:12.899256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c371a6-1419-47bb-b96d-32c8f940dce2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:12.908403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c371a6-1419-47bb-b96d-32c8f940dce2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:12.908403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c371a6-1419-47bb-b96d-32c8f940dce2 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:12.908403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c371a6-1419-47bb-b96d-32c8f940dce2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:12.908403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c371a6-1419-47bb-b96d-32c8f940dce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:12.908403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c371a6-1419-47bb-b96d-32c8f940dce2 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:12.908403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 461/913] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:12.914779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c371a6-1419-47bb-b96d-32c8f940dce2 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:12.994559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79c26-39df-4dd8-888f-604c90344fa4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:13.034892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71690b23-1fd8-41c0-8936-68f4fb0288c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:13.035710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71690b23-1fd8-41c0-8936-68f4fb0288c7 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:13.036087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71690b23-1fd8-41c0-8936-68f4fb0288c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:13.036370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71690b23-1fd8-41c0-8936-68f4fb0288c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:13.044237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71690b23-1fd8-41c0-8936-68f4fb0288c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:13.045722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71690b23-1fd8-41c0-8936-68f4fb0288c7 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:13.054209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c371a6-1419-47bb-b96d-32c8f940dce2 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:13.057451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-71690b23-1fd8-41c0-8936-68f4fb0288c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:13.060867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:13.061774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:13.062707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:13.062707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:13.062707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:13.062707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:13.062707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:13.062707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:13.062707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:13.062707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:13.062707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 453/914] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:13.068122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71690b23-1fd8-41c0-8936-68f4fb0288c7 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:13.098972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd85ac-89f7-4ecd-ad7e-c1f85a545f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:13.099594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd85ac-89f7-4ecd-ad7e-c1f85a545f7d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:13.099872 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd85ac-89f7-4ecd-ad7e-c1f85a545f7d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:13.100139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd85ac-89f7-4ecd-ad7e-c1f85a545f7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:13.102027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd85ac-89f7-4ecd-ad7e-c1f85a545f7d None admin] RBAC: Adding query filter params (interface=public, service_id=9f03ef335eb14978a40474638eb510b2, region_id=RegionOne) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:13.102027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd85ac-89f7-4ecd-ad7e-c1f85a545f7d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:13.103489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd85ac-89f7-4ecd-ad7e-c1f85a545f7d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:13.112179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 462/915] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 15:38:12 2022] GET /identity/v3/endpoints?service_id=9f03ef335eb14978a40474638eb510b2&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:13.118845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd85ac-89f7-4ecd-ad7e-c1f85a545f7d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:13.182201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:13.204489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71690b23-1fd8-41c0-8936-68f4fb0288c7 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:13.250833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39a854-8e5d-42df-b192-0e84a271dcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:13.251808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39a854-8e5d-42df-b192-0e84a271dcd2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:13.252392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39a854-8e5d-42df-b192-0e84a271dcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:13.252910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39a854-8e5d-42df-b192-0e84a271dcd2 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:13.253826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39a854-8e5d-42df-b192-0e84a271dcd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:13.254320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39a854-8e5d-42df-b192-0e84a271dcd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:13.255928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39a854-8e5d-42df-b192-0e84a271dcd2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:13.261727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd85ac-89f7-4ecd-ad7e-c1f85a545f7d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:13.276454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 454/916] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:13.277851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39a854-8e5d-42df-b192-0e84a271dcd2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:13.327395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9878b1-4ec6-4a27-a7f5-8843d559a103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:13.328376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9878b1-4ec6-4a27-a7f5-8843d559a103 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:13.328698 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9878b1-4ec6-4a27-a7f5-8843d559a103 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:13.329090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9878b1-4ec6-4a27-a7f5-8843d559a103 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:13.330118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9878b1-4ec6-4a27-a7f5-8843d559a103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:13.332004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9878b1-4ec6-4a27-a7f5-8843d559a103 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:13.342366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 463/917] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 15:38:13 2022] GET /identity/v3/services => generated 1497 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:38:13.344204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ef7b-3cfe-4591-aa90-16d84d48e58c None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:13.344613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ef7b-3cfe-4591-aa90-16d84d48e58c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:13.345012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0ef7b-3cfe-4591-aa90-16d84d48e58c None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:13.347483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 464/918] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:13.357447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b660d0-fea7-45a7-b21a-390002c0038f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:13.357988 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b660d0-fea7-45a7-b21a-390002c0038f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:13.358467 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b660d0-fea7-45a7-b21a-390002c0038f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:13.379476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-78b660d0-fea7-45a7-b21a-390002c0038f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:13.381060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-78b660d0-fea7-45a7-b21a-390002c0038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:13.404711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39a854-8e5d-42df-b192-0e84a271dcd2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:13.410108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:13.448838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a5e9-28da-4cbb-936d-31f7d38d7d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:13.449685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a5e9-28da-4cbb-936d-31f7d38d7d0b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:13.450056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a5e9-28da-4cbb-936d-31f7d38d7d0b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:13.450420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a5e9-28da-4cbb-936d-31f7d38d7d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:13.451355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3a5e9-28da-4cbb-936d-31f7d38d7d0b None admin] RBAC: Adding query filter params (role.id=bd1525385a604a11ae4a956f07a384b9, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=3f087c40f6514c3a84a4131bc5585fea) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:13.451768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3a5e9-28da-4cbb-936d-31f7d38d7d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:13.453390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3a5e9-28da-4cbb-936d-31f7d38d7d0b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:13.459858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 455/919] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:13 2022] GET /identity/v3/role_assignments?user.id=3f087c40f6514c3a84a4131bc5585fea&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=bd1525385a604a11ae4a956f07a384b9 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:13.479776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 465/920] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:13.774995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a5e9-28da-4cbb-936d-31f7d38d7d0b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:13.785729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:13.887747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a5e9-28da-4cbb-936d-31f7d38d7d0b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:13.924838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a5c18-ceff-496c-a1e7-d4b537806db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:13.925875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a5c18-ceff-496c-a1e7-d4b537806db8 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:13.926368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a5c18-ceff-496c-a1e7-d4b537806db8 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:13.926849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a5c18-ceff-496c-a1e7-d4b537806db8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:13.927660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a5c18-ceff-496c-a1e7-d4b537806db8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:13.929833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a5c18-ceff-496c-a1e7-d4b537806db8 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-967a5c18-ceff-496c-a1e7-d4b537806db8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:13.939664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:13.940898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:13.941828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:13.948875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 456/921] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:13.951033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b660d0-fea7-45a7-b21a-390002c0038f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:14.072665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b660d0-fea7-45a7-b21a-390002c0038f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:14.112120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f3e80-7a6f-4d66-a1eb-72323102a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:14.112807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f3e80-7a6f-4d66-a1eb-72323102a891 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:14.113093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f3e80-7a6f-4d66-a1eb-72323102a891 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:14.113368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f3e80-7a6f-4d66-a1eb-72323102a891 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:14.114042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f3e80-7a6f-4d66-a1eb-72323102a891 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:14.114351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f3e80-7a6f-4d66-a1eb-72323102a891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:14.115968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f3e80-7a6f-4d66-a1eb-72323102a891 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:14.123047 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 466/922] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 15:38:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:14.129047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a5c18-ceff-496c-a1e7-d4b537806db8 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:14.209375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:14.245439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a5c18-ceff-496c-a1e7-d4b537806db8 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:14.284940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2b70f-200c-4aea-89e5-9f8ec49d4f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:14.285643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b70f-200c-4aea-89e5-9f8ec49d4f28 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:14.285930 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b70f-200c-4aea-89e5-9f8ec49d4f28 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:14.286205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2b70f-200c-4aea-89e5-9f8ec49d4f28 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:14.286857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2b70f-200c-4aea-89e5-9f8ec49d4f28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:14.287168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2b70f-200c-4aea-89e5-9f8ec49d4f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:14.288647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2b70f-200c-4aea-89e5-9f8ec49d4f28 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:14.295413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 457/923] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 15:38:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:14.301762 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f3e80-7a6f-4d66-a1eb-72323102a891 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:14.332835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:14.432387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f3e80-7a6f-4d66-a1eb-72323102a891 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:14.474990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a36b7d-af40-4cb8-841f-f7f28a11ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:14.476293 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36b7d-af40-4cb8-841f-f7f28a11ea22 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:14.476610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36b7d-af40-4cb8-841f-f7f28a11ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:14.476933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36b7d-af40-4cb8-841f-f7f28a11ea22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:14.477607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a36b7d-af40-4cb8-841f-f7f28a11ea22 None admin] RBAC: Adding query filter params (interface=public, service_id=51cce1192738465da2805a855f4ba4a1, region_id=RegionOne) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:14.477921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a36b7d-af40-4cb8-841f-f7f28a11ea22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:14.479324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a36b7d-af40-4cb8-841f-f7f28a11ea22 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:14.485818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 467/924] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 15:38:14 2022] GET /identity/v3/endpoints?service_id=51cce1192738465da2805a855f4ba4a1&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:14.492246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2b70f-200c-4aea-89e5-9f8ec49d4f28 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:14.610648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2b70f-200c-4aea-89e5-9f8ec49d4f28 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:14.649189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a35dd2-71fe-4c79-898b-ffc734b71679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:14.650144 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a35dd2-71fe-4c79-898b-ffc734b71679 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:14.650618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a35dd2-71fe-4c79-898b-ffc734b71679 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:14.651082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a35dd2-71fe-4c79-898b-ffc734b71679 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:14.651895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a35dd2-71fe-4c79-898b-ffc734b71679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:14.653559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a35dd2-71fe-4c79-898b-ffc734b71679 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:14.655004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:14.660713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 458/925] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 15:38:14 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:38:15.125831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55d98f-2030-482b-88fe-1bac2649b84e None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:15.126670 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55d98f-2030-482b-88fe-1bac2649b84e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:15.127332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55d98f-2030-482b-88fe-1bac2649b84e None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:15.130055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 468/926] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:15.138378 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81687d85-beb9-491f-9113-ce3136c65363 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:15.139495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81687d85-beb9-491f-9113-ce3136c65363 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:15.140075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81687d85-beb9-491f-9113-ce3136c65363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:15.162244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-81687d85-beb9-491f-9113-ce3136c65363 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:15.163788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-81687d85-beb9-491f-9113-ce3136c65363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:15.258910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 459/927] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:15.529241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b987e-8494-4971-adef-f7626efd0b9f None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:15.529763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b987e-8494-4971-adef-f7626efd0b9f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:15.529763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b987e-8494-4971-adef-f7626efd0b9f None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:15.531411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 469/928] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:15.537456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b721-050d-4752-9b2c-5656ac280927 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:15.537900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b721-050d-4752-9b2c-5656ac280927 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:15.538777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464b721-050d-4752-9b2c-5656ac280927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:15.544772 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b987e-8494-4971-adef-f7626efd0b9f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:15.568874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b464b721-050d-4752-9b2c-5656ac280927 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:15.571285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b464b721-050d-4752-9b2c-5656ac280927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:15.665524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:15.681329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 460/929] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:15.682878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693cefa-cde9-451f-bc08-04417bb18315 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:15.683077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b987e-8494-4971-adef-f7626efd0b9f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:15.683192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693cefa-cde9-451f-bc08-04417bb18315 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:15.683431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693cefa-cde9-451f-bc08-04417bb18315 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:15.684904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 461/930] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:15.701320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c048f-8095-42e6-9a5a-812467994b02 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:15.702457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c048f-8095-42e6-9a5a-812467994b02 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:15.702889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c048f-8095-42e6-9a5a-812467994b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:15.733580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:15.734359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:15.734740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:15.735131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:15.736024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:15.737683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:15.738025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-716c048f-8095-42e6-9a5a-812467994b02 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:15.739446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-716c048f-8095-42e6-9a5a-812467994b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:15.741992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: WARNING keystone.server.flask.common [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 15:38:15.811626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.sql.core [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 15:38:15.811626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 15:38:15.811626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [parameters: {'id': '1970635cbb8642f6b9a574eb6f6b5b5c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 15:38:15.811626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98421) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1970635cbb8642f6b9a574eb6f6b5b5c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1970635cbb8642f6b9a574eb6f6b5b5c. Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:38:15.819564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result.read() Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 15:38:15.820455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application yield resource Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise self.value Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application session.commit() Aug 22 15:38:15.821801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.session.flush() Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application compat.raise_( Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 15:38:15.822912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 15:38:15.824882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result.read() Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:38:15.827282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [parameters: {'id': '1970635cbb8642f6b9a574eb6f6b5b5c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:15.830350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:15.834322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1970635cbb8642f6b9a574eb6f6b5b5c. Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 470/931] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Aug 22 15:38:15 2022] POST /identity/v3/projects => generated 262 bytes in 277 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:15.840748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:15.849829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:15.876125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 462/932] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:15.949521 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713afa4-7d50-4b0a-b4ba-2051b5bff6da None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:15.999132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd201ad-5cad-4f16-82c7-a3bef0189b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:16.000152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd201ad-5cad-4f16-82c7-a3bef0189b33 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:16.000630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd201ad-5cad-4f16-82c7-a3bef0189b33 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:16.001162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd201ad-5cad-4f16-82c7-a3bef0189b33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:16.010860 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd201ad-5cad-4f16-82c7-a3bef0189b33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:16.013129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd201ad-5cad-4f16-82c7-a3bef0189b33 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-9cd201ad-5cad-4f16-82c7-a3bef0189b33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:16.033292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:16.034311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:16.035307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:16.035307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:16.035307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:16.035307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:16.035307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:16.035307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:16.035307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:16.035307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:16.037370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c048f-8095-42e6-9a5a-812467994b02 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:16.038069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 471/933] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:16.047438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd201ad-5cad-4f16-82c7-a3bef0189b33 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:16.052074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:16.176680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c048f-8095-42e6-9a5a-812467994b02 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:16.208484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd201ad-5cad-4f16-82c7-a3bef0189b33 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:16.219921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0e372-a758-4ef2-a6ef-d4b0c9031f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:16.220590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0e372-a758-4ef2-a6ef-d4b0c9031f31 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:16.220874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0e372-a758-4ef2-a6ef-d4b0c9031f31 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:16.221147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0e372-a758-4ef2-a6ef-d4b0c9031f31 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:16.221736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0e372-a758-4ef2-a6ef-d4b0c9031f31 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:16.223111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0e372-a758-4ef2-a6ef-d4b0c9031f31 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-09d0e372-a758-4ef2-a6ef-d4b0c9031f31 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:16.233107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:16.234495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:16.235769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 463/934] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Aug 22 15:38:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:16.238394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0e372-a758-4ef2-a6ef-d4b0c9031f31 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:16.265809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed2cf0-91f9-44e6-910a-e7525393c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:16.266483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2cf0-91f9-44e6-910a-e7525393c450 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:16.266772 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2cf0-91f9-44e6-910a-e7525393c450 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:16.267045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2cf0-91f9-44e6-910a-e7525393c450 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:16.267729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed2cf0-91f9-44e6-910a-e7525393c450 None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:16.268036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed2cf0-91f9-44e6-910a-e7525393c450 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:16.270199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed2cf0-91f9-44e6-910a-e7525393c450 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:16.308556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 472/935] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:38:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:16.308556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed2cf0-91f9-44e6-910a-e7525393c450 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:16.309883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:16.382118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0e372-a758-4ef2-a6ef-d4b0c9031f31 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:16.407940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:16.424194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e35fb-c4fd-49e6-8bd7-be7223d4bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:16.424945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e35fb-c4fd-49e6-8bd7-be7223d4bcbd None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:16.425223 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e35fb-c4fd-49e6-8bd7-be7223d4bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:16.425495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e35fb-c4fd-49e6-8bd7-be7223d4bcbd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:16.438694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e35fb-c4fd-49e6-8bd7-be7223d4bcbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-140e35fb-c4fd-49e6-8bd7-be7223d4bcbd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:16.444501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:16.445612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:16.446465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 464/936] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 15:38:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:16.458207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e35fb-c4fd-49e6-8bd7-be7223d4bcbd None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:16.487407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed2cf0-91f9-44e6-910a-e7525393c450 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:16.542962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50e138-b7d1-43ab-a735-662237db04e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:16.544691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50e138-b7d1-43ab-a735-662237db04e3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:16.545150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50e138-b7d1-43ab-a735-662237db04e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:16.546034 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50e138-b7d1-43ab-a735-662237db04e3 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:16.546759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50e138-b7d1-43ab-a735-662237db04e3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:16.547072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50e138-b7d1-43ab-a735-662237db04e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:16.548489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50e138-b7d1-43ab-a735-662237db04e3 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:16.555084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 473/937] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:16.561918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50e138-b7d1-43ab-a735-662237db04e3 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:16.614489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e35fb-c4fd-49e6-8bd7-be7223d4bcbd None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:16.632845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:16.668095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0b6fb-e71b-47a2-9a55-705c9aee507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:16.669036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b6fb-e71b-47a2-9a55-705c9aee507e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:16.669412 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b6fb-e71b-47a2-9a55-705c9aee507e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:16.669782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0b6fb-e71b-47a2-9a55-705c9aee507e None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:16.670683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0b6fb-e71b-47a2-9a55-705c9aee507e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:16.671537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0b6fb-e71b-47a2-9a55-705c9aee507e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:16.673499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0b6fb-e71b-47a2-9a55-705c9aee507e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:16.688464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 465/938] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 15:38:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:16.694409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0b6fb-e71b-47a2-9a55-705c9aee507e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:16.702942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50e138-b7d1-43ab-a735-662237db04e3 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:16.744182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:16.757926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6832705-c685-47b8-ae56-6208aaf2c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:16.759573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6832705-c685-47b8-ae56-6208aaf2c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:16.760262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6832705-c685-47b8-ae56-6208aaf2c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:16.760671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6832705-c685-47b8-ae56-6208aaf2c4b0 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:16.761834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6832705-c685-47b8-ae56-6208aaf2c4b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:16.762890 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6832705-c685-47b8-ae56-6208aaf2c4b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:16.765508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6832705-c685-47b8-ae56-6208aaf2c4b0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:16.780747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 474/939] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:16.784032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6832705-c685-47b8-ae56-6208aaf2c4b0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:16.824272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0b6fb-e71b-47a2-9a55-705c9aee507e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:16.870462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c3394-c302-403e-9d7e-d60cc2a72b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:16.871133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3394-c302-403e-9d7e-d60cc2a72b96 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:16.871406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3394-c302-403e-9d7e-d60cc2a72b96 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:16.871737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3394-c302-403e-9d7e-d60cc2a72b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:16.884601 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c3394-c302-403e-9d7e-d60cc2a72b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:16.886095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c3394-c302-403e-9d7e-d60cc2a72b96 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:16.903245 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6832705-c685-47b8-ae56-6208aaf2c4b0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-788c3394-c302-403e-9d7e-d60cc2a72b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:16.905112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:16.906278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:16.907398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:16.907398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:16.907398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:16.912494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 466/940] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:16.913819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba7bb2-0048-43ad-aeaf-e165e943fa22 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:16.914096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba7bb2-0048-43ad-aeaf-e165e943fa22 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:16.914369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba7bb2-0048-43ad-aeaf-e165e943fa22 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:16.915842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 467/941] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:16.916401 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba7bb2-0048-43ad-aeaf-e165e943fa22 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:16.951407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:16.954862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc9569-1a9f-41a4-a58d-b23f2a7b5ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:16.955634 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9569-1a9f-41a4-a58d-b23f2a7b5ffa None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:16.956050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9569-1a9f-41a4-a58d-b23f2a7b5ffa None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:16.956284 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9569-1a9f-41a4-a58d-b23f2a7b5ffa None admin] PATH_INFO: `/v3/endpoints` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:16.956964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc9569-1a9f-41a4-a58d-b23f2a7b5ffa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:16.958425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc9569-1a9f-41a4-a58d-b23f2a7b5ffa None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:17.043143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba7bb2-0048-43ad-aeaf-e165e943fa22 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:17.052408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 475/942] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:38:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:38:17.054045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab818a-c95d-4e8f-9f28-afee536cff8b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:17.054669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab818a-c95d-4e8f-9f28-afee536cff8b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:17.055091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab818a-c95d-4e8f-9f28-afee536cff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:17.078350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-22ab818a-c95d-4e8f-9f28-afee536cff8b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:17.080834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-22ab818a-c95d-4e8f-9f28-afee536cff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:17.111041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee6bd5-9405-475b-bba0-c19c0b91bbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:17.111388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee6bd5-9405-475b-bba0-c19c0b91bbc1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:17.111733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee6bd5-9405-475b-bba0-c19c0b91bbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:17.112010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee6bd5-9405-475b-bba0-c19c0b91bbc1 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:17.112791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee6bd5-9405-475b-bba0-c19c0b91bbc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:17.113100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee6bd5-9405-475b-bba0-c19c0b91bbc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:17.114530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee6bd5-9405-475b-bba0-c19c0b91bbc1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:17.131372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 468/943] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:17.138054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee6bd5-9405-475b-bba0-c19c0b91bbc1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:17.149454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:17.188405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 476/944] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:17.260497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:17.284361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee6bd5-9405-475b-bba0-c19c0b91bbc1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:17.328532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d8ae-596c-47ec-85f0-c583e88e7e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:17.329216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d8ae-596c-47ec-85f0-c583e88e7e84 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:17.329492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d8ae-596c-47ec-85f0-c583e88e7e84 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:17.329763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d8ae-596c-47ec-85f0-c583e88e7e84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:17.339448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21d8ae-596c-47ec-85f0-c583e88e7e84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:17.340961 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21d8ae-596c-47ec-85f0-c583e88e7e84 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-7a21d8ae-596c-47ec-85f0-c583e88e7e84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:17.361347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:17.362603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:17.363818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 469/945] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 15:38:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:17.370422 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab818a-c95d-4e8f-9f28-afee536cff8b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:17.479901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d8ae-596c-47ec-85f0-c583e88e7e84 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:17.502663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab818a-c95d-4e8f-9f28-afee536cff8b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:17.540343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acf29a-fbdb-4ab8-8ee1-c1a89a6fb085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:17.540942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acf29a-fbdb-4ab8-8ee1-c1a89a6fb085 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:17.541223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acf29a-fbdb-4ab8-8ee1-c1a89a6fb085 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:17.541501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acf29a-fbdb-4ab8-8ee1-c1a89a6fb085 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:17.542786 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acf29a-fbdb-4ab8-8ee1-c1a89a6fb085 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:17.543099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acf29a-fbdb-4ab8-8ee1-c1a89a6fb085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:17.544583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acf29a-fbdb-4ab8-8ee1-c1a89a6fb085 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:17.570455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 477/946] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 15:38:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:17.577187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acf29a-fbdb-4ab8-8ee1-c1a89a6fb085 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:17.612673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d8ae-596c-47ec-85f0-c583e88e7e84 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:17.632967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:17.660893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3188f-9ad6-4878-98c8-a44383cd5191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:17.661542 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3188f-9ad6-4878-98c8-a44383cd5191 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:17.661884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3188f-9ad6-4878-98c8-a44383cd5191 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:17.662164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3188f-9ad6-4878-98c8-a44383cd5191 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:17.662760 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3188f-9ad6-4878-98c8-a44383cd5191 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:17.664693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3188f-9ad6-4878-98c8-a44383cd5191 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-1ed3188f-9ad6-4878-98c8-a44383cd5191 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:17.682360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:17.683943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:17.684860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 470/947] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:17.693440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3188f-9ad6-4878-98c8-a44383cd5191 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:17.706191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acf29a-fbdb-4ab8-8ee1-c1a89a6fb085 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:17.707768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:17.748730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d690-5a8d-4df9-bfed-66078baa4bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:17.750776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d690-5a8d-4df9-bfed-66078baa4bdc None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:17.751292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d690-5a8d-4df9-bfed-66078baa4bdc None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:17.751766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d690-5a8d-4df9-bfed-66078baa4bdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:17.771977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214d690-5a8d-4df9-bfed-66078baa4bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:17.774045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214d690-5a8d-4df9-bfed-66078baa4bdc None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-c214d690-5a8d-4df9-bfed-66078baa4bdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:17.799321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:17.800353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:17.801352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:17.801352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:17.801352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:17.801526 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 478/948] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:17.808960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d690-5a8d-4df9-bfed-66078baa4bdc None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:17.831297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3188f-9ad6-4878-98c8-a44383cd5191 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:17.869345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d8c7-239b-4caa-b3e4-95a3759c6fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:17.870174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d8c7-239b-4caa-b3e4-95a3759c6fc4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:17.870638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d8c7-239b-4caa-b3e4-95a3759c6fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:17.871068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d8c7-239b-4caa-b3e4-95a3759c6fc4 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:17.871864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910d8c7-239b-4caa-b3e4-95a3759c6fc4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:17.872150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910d8c7-239b-4caa-b3e4-95a3759c6fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:17.873740 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910d8c7-239b-4caa-b3e4-95a3759c6fc4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:17.879551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 471/949] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 15:38:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:17.892794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d8c7-239b-4caa-b3e4-95a3759c6fc4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:17.904102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:17.925819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d690-5a8d-4df9-bfed-66078baa4bdc None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:17.976085 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac4455-84bf-4331-a351-07eb02e59cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:17.977177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4455-84bf-4331-a351-07eb02e59cd3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:17.977775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4455-84bf-4331-a351-07eb02e59cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:17.978600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac4455-84bf-4331-a351-07eb02e59cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:17.979486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac4455-84bf-4331-a351-07eb02e59cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:17.980043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac4455-84bf-4331-a351-07eb02e59cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:17.981917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac4455-84bf-4331-a351-07eb02e59cd3 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:17.992645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:17.997932 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 479/950] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:18.004638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac4455-84bf-4331-a351-07eb02e59cd3 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:18.035745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d8c7-239b-4caa-b3e4-95a3759c6fc4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:18.082562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c29fe-fe1b-4b05-b7e7-d54c28b3cba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:18.083139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c29fe-fe1b-4b05-b7e7-d54c28b3cba4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:18.083417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c29fe-fe1b-4b05-b7e7-d54c28b3cba4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:18.083682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c29fe-fe1b-4b05-b7e7-d54c28b3cba4 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:18.084564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c29fe-fe1b-4b05-b7e7-d54c28b3cba4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:18.084727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c29fe-fe1b-4b05-b7e7-d54c28b3cba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:18.086384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c29fe-fe1b-4b05-b7e7-d54c28b3cba4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:18.092257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 472/951] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 15:38:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:18.097479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c29fe-fe1b-4b05-b7e7-d54c28b3cba4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:18.136502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac4455-84bf-4331-a351-07eb02e59cd3 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:18.184564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf71d-287c-4fc2-8c91-01dbe6f0fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:18.184564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf71d-287c-4fc2-8c91-01dbe6f0fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:18.184877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf71d-287c-4fc2-8c91-01dbe6f0fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:18.185292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf71d-287c-4fc2-8c91-01dbe6f0fbf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:18.196178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cf71d-287c-4fc2-8c91-01dbe6f0fbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:18.198045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cf71d-287c-4fc2-8c91-01dbe6f0fbf8 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-3f7cf71d-287c-4fc2-8c91-01dbe6f0fbf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:18.210479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:18.211669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:18.212878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:18.212878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:18.212878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:18.212878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:18.212878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:18.212878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:18.212878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:18.212878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:18.220557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 480/952] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:18.220744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c29fe-fe1b-4b05-b7e7-d54c28b3cba4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:18.220856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf71d-287c-4fc2-8c91-01dbe6f0fbf8 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:18.230844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:18.267755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fec32-cd78-4e78-9476-35955051a114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:18.269580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fec32-cd78-4e78-9476-35955051a114 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:18.270034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fec32-cd78-4e78-9476-35955051a114 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:18.270475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fec32-cd78-4e78-9476-35955051a114 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:18.271735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fec32-cd78-4e78-9476-35955051a114 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:18.273654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fec32-cd78-4e78-9476-35955051a114 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:18.280621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:18.358672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf71d-287c-4fc2-8c91-01dbe6f0fbf8 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:18.363805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 473/953] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:38:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:38:18.439945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad7082-0448-4c7c-8ec4-61171a768aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:18.441238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7082-0448-4c7c-8ec4-61171a768aaa None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:18.441891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7082-0448-4c7c-8ec4-61171a768aaa None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:18.442504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7082-0448-4c7c-8ec4-61171a768aaa None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:18.443993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad7082-0448-4c7c-8ec4-61171a768aaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:18.444773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad7082-0448-4c7c-8ec4-61171a768aaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:18.447640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad7082-0448-4c7c-8ec4-61171a768aaa None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:18.473119 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 481/954] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:18.483593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fec32-cd78-4e78-9476-35955051a114 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:18.639126 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fec32-cd78-4e78-9476-35955051a114 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:18.689048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92c0cb-8fbd-4942-affa-bd3db145418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:18.689725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c0cb-8fbd-4942-affa-bd3db145418e None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:18.690000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c0cb-8fbd-4942-affa-bd3db145418e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:18.690274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c0cb-8fbd-4942-affa-bd3db145418e None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/3f087c40f6514c3a84a4131bc5585fea/roles/bd1525385a604a11ae4a956f07a384b9` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:18.692553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92c0cb-8fbd-4942-affa-bd3db145418e None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=3f087c40f6514c3a84a4131bc5585fea, role_id=bd1525385a604a11ae4a956f07a384b9)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:18.694262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c48e72-2e2d-46ce-a0de-44060ce1cde8 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:18.694820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c48e72-2e2d-46ce-a0de-44060ce1cde8 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:18.694820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c48e72-2e2d-46ce-a0de-44060ce1cde8 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:18.696337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 482/955] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:38:18.697721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92c0cb-8fbd-4942-affa-bd3db145418e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:18.707821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200a39d-e828-4f60-99f8-5317af277c3c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:18.707821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200a39d-e828-4f60-99f8-5317af277c3c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:18.707821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200a39d-e828-4f60-99f8-5317af277c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:18.722568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-6200a39d-e828-4f60-99f8-5317af277c3c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:18.723766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6200a39d-e828-4f60-99f8-5317af277c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:18.785282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:18.799028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 483/956] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:18.875553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 474/957] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:38:18 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/3f087c40f6514c3a84a4131bc5585fea/roles/bd1525385a604a11ae4a956f07a384b9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:38:19.090748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200a39d-e828-4f60-99f8-5317af277c3c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:19.198977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200a39d-e828-4f60-99f8-5317af277c3c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:19.235720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81446bba-bd1d-4bc2-82bd-915fcae51d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:19.236344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446bba-bd1d-4bc2-82bd-915fcae51d9b None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:19.236654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446bba-bd1d-4bc2-82bd-915fcae51d9b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:19.236927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446bba-bd1d-4bc2-82bd-915fcae51d9b None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:19.237583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81446bba-bd1d-4bc2-82bd-915fcae51d9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:19.239021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81446bba-bd1d-4bc2-82bd-915fcae51d9b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:19.242882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadce3a3-f0d5-4d9b-98da-42da5d655373 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:19.243406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadce3a3-f0d5-4d9b-98da-42da5d655373 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:19.243890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadce3a3-f0d5-4d9b-98da-42da5d655373 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:19.245744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 475/958] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:38:19.251584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39734f8-f747-453a-8c6d-edb33d39feb8 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:19.252201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39734f8-f747-453a-8c6d-edb33d39feb8 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:19.252539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39734f8-f747-453a-8c6d-edb33d39feb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:19.272013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d39734f8-f747-453a-8c6d-edb33d39feb8 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:19.274306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d39734f8-f747-453a-8c6d-edb33d39feb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:19.298018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.sql.core [None req-81446bba-bd1d-4bc2-82bd-915fcae51d9b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 15:38:19.298018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 15:38:19.298018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [parameters: {'user_id': 'f5e9961ab13f4e9196b884fa3ada786c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 15:38:19.298018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98421) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-81446bba-bd1d-4bc2-82bd-915fcae51d9b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result.read() Aug 22 15:38:19.308811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:38:19.312302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application yield resource Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise self.value Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application session.commit() Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 15:38:19.313457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.session.flush() Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application compat.raise_( Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 15:38:19.314385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:38:19.315304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application result.read() Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:38:19.316385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f5e9961ab13f4e9196b884fa3ada786c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:19.317319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 15:38:19.318319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 15:38:19.320021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 15:38:19.320021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 15:38:19.320021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 15:38:19.320021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 15:38:19.320021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 15:38:19.320021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:19.320021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 484/959] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Aug 22 15:38:19 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:19.322054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81446bba-bd1d-4bc2-82bd-915fcae51d9b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:19.339254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:19.369279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 476/960] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:19.391539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:19.438543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81446bba-bd1d-4bc2-82bd-915fcae51d9b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:19.479202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7867c-1984-48ea-b53f-87a5fad5471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:19.480176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7867c-1984-48ea-b53f-87a5fad5471e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:19.480684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7867c-1984-48ea-b53f-87a5fad5471e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:19.481104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7867c-1984-48ea-b53f-87a5fad5471e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:19.489561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7867c-1984-48ea-b53f-87a5fad5471e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:19.491958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7867c-1984-48ea-b53f-87a5fad5471e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-a4d7867c-1984-48ea-b53f-87a5fad5471e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:19.505189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:19.506437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:19.508247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:19.508247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:19.508247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:19.508247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:19.508247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:19.508247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:19.508247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:19.508247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:19.508247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:38:19.508247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:19.510542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 485/961] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:38:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:19.517730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39734f8-f747-453a-8c6d-edb33d39feb8 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:19.641595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39734f8-f747-453a-8c6d-edb33d39feb8 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:19.689381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c8ad3-6648-4eb6-b27a-121dd6423f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:19.690727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8ad3-6648-4eb6-b27a-121dd6423f87 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:19.691501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8ad3-6648-4eb6-b27a-121dd6423f87 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:19.692158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8ad3-6648-4eb6-b27a-121dd6423f87 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:19.692977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7867c-1984-48ea-b53f-87a5fad5471e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:19.693798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c8ad3-6648-4eb6-b27a-121dd6423f87 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:19.694942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c8ad3-6648-4eb6-b27a-121dd6423f87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:19.696624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c8ad3-6648-4eb6-b27a-121dd6423f87 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:19.745822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 477/962] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 15:38:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:19.817155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7867c-1984-48ea-b53f-87a5fad5471e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:19.835013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:19.858829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655c0bc-6bc0-446d-852f-c7177e816bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:19.859822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655c0bc-6bc0-446d-852f-c7177e816bc2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:19.860300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655c0bc-6bc0-446d-852f-c7177e816bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:19.860754 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655c0bc-6bc0-446d-852f-c7177e816bc2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:19.861526 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655c0bc-6bc0-446d-852f-c7177e816bc2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:19.863118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655c0bc-6bc0-446d-852f-c7177e816bc2 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-b655c0bc-6bc0-446d-852f-c7177e816bc2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:19.873882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:19.875327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:38:19.876490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:19.879238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 486/963] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:19.885167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c8ad3-6648-4eb6-b27a-121dd6423f87 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:19.937748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:20.010196 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c8ad3-6648-4eb6-b27a-121dd6423f87 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:20.050990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a0ca5-e65e-439f-beb4-12dd4e6b997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:20.051877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a0ca5-e65e-439f-beb4-12dd4e6b997a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:20.052304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a0ca5-e65e-439f-beb4-12dd4e6b997a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:20.052757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a0ca5-e65e-439f-beb4-12dd4e6b997a None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:20.054199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a0ca5-e65e-439f-beb4-12dd4e6b997a None admin] RBAC: Adding query filter params (name=compute) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:20.054646 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a0ca5-e65e-439f-beb4-12dd4e6b997a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:20.056167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a0ca5-e65e-439f-beb4-12dd4e6b997a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:20.061758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 478/964] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:38:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:20.067110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655c0bc-6bc0-446d-852f-c7177e816bc2 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:20.173612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655c0bc-6bc0-446d-852f-c7177e816bc2 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:20.208887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e3308-da3f-4044-bc53-42b3e15aed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:20.209500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e3308-da3f-4044-bc53-42b3e15aed95 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:20.209912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e3308-da3f-4044-bc53-42b3e15aed95 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:20.210185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e3308-da3f-4044-bc53-42b3e15aed95 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:20.210813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e3308-da3f-4044-bc53-42b3e15aed95 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:20.211111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e3308-da3f-4044-bc53-42b3e15aed95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:20.212471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e3308-da3f-4044-bc53-42b3e15aed95 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:20.228609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 487/965] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:38:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:20.470519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9544-9861-4c39-8444-3791a4a6d55e None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:20.471017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9544-9861-4c39-8444-3791a4a6d55e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:20.471017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9544-9861-4c39-8444-3791a4a6d55e None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:20.472466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 479/966] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:20.480405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba8a1-0c65-4962-9570-45fde15e7df7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:20.480812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba8a1-0c65-4962-9570-45fde15e7df7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:20.481161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aba8a1-0c65-4962-9570-45fde15e7df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:20.499653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-56aba8a1-0c65-4962-9570-45fde15e7df7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:20.501213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-56aba8a1-0c65-4962-9570-45fde15e7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:20.540741 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:20.573910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 488/967] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:20.848731 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e9544-9861-4c39-8444-3791a4a6d55e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:20.870311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab7efb-169e-4b0b-be45-24f25c73f716 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:20.870848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab7efb-169e-4b0b-be45-24f25c73f716 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:20.870848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab7efb-169e-4b0b-be45-24f25c73f716 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:20.872582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 489/968] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:20.878874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751497cb-c6c5-4df9-8f05-dbd381557c6a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:20.879187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751497cb-c6c5-4df9-8f05-dbd381557c6a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:20.879425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751497cb-c6c5-4df9-8f05-dbd381557c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:20.905150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-751497cb-c6c5-4df9-8f05-dbd381557c6a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:20.906881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-751497cb-c6c5-4df9-8f05-dbd381557c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:20.973058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e9544-9861-4c39-8444-3791a4a6d55e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:20.974780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:21.009989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 490/969] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:21.015067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40e306-62ef-4411-8fae-0a8a5da38cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:21.016270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40e306-62ef-4411-8fae-0a8a5da38cac None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:21.016270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40e306-62ef-4411-8fae-0a8a5da38cac None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:21.016469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40e306-62ef-4411-8fae-0a8a5da38cac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:21.016986 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40e306-62ef-4411-8fae-0a8a5da38cac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:21.018365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40e306-62ef-4411-8fae-0a8a5da38cac None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-7e40e306-62ef-4411-8fae-0a8a5da38cac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:21.027819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:21.029203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:21.030285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:21.033318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 480/970] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:21.038900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751497cb-c6c5-4df9-8f05-dbd381557c6a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:21.143307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751497cb-c6c5-4df9-8f05-dbd381557c6a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:21.144837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:21.179395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc07b-398d-4900-81ef-3578720d43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:21.180012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc07b-398d-4900-81ef-3578720d43ee None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:21.180290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc07b-398d-4900-81ef-3578720d43ee None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:21.180579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc07b-398d-4900-81ef-3578720d43ee None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:21.181331 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc07b-398d-4900-81ef-3578720d43ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:21.181735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc07b-398d-4900-81ef-3578720d43ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:21.183141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc07b-398d-4900-81ef-3578720d43ee None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:21.192706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 491/971] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 15:38:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:21.194853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40e306-62ef-4411-8fae-0a8a5da38cac None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:21.281242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc07b-398d-4900-81ef-3578720d43ee None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:21.327765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40e306-62ef-4411-8fae-0a8a5da38cac None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:21.366534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4792de-ab15-4243-bf07-b4795a229267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:21.367143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4792de-ab15-4243-bf07-b4795a229267 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:21.367416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4792de-ab15-4243-bf07-b4795a229267 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:21.367684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4792de-ab15-4243-bf07-b4795a229267 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:21.368307 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4792de-ab15-4243-bf07-b4795a229267 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:21.368637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4792de-ab15-4243-bf07-b4795a229267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:21.369998 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4792de-ab15-4243-bf07-b4795a229267 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:21.375031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 481/972] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 15:38:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:21.381535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4792de-ab15-4243-bf07-b4795a229267 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:21.406822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc07b-398d-4900-81ef-3578720d43ee None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:21.414693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:21.445237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18813-2939-4afd-a903-0c87253c6ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:21.446089 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18813-2939-4afd-a903-0c87253c6ce3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:21.446445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18813-2939-4afd-a903-0c87253c6ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:21.446816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f18813-2939-4afd-a903-0c87253c6ce3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:21.458085 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f18813-2939-4afd-a903-0c87253c6ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-07f18813-2939-4afd-a903-0c87253c6ce3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:21.462897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:21.463946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:21.465259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 492/973] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 15:38:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:21.470140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18813-2939-4afd-a903-0c87253c6ce3 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:21.496080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4792de-ab15-4243-bf07-b4795a229267 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:21.500178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:21.537391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e46ce-cc9c-4c09-9dd3-18e94fee5a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:21.538513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e46ce-cc9c-4c09-9dd3-18e94fee5a07 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:21.538795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e46ce-cc9c-4c09-9dd3-18e94fee5a07 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:21.539065 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e46ce-cc9c-4c09-9dd3-18e94fee5a07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:21.539799 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e46ce-cc9c-4c09-9dd3-18e94fee5a07 None admin] RBAC: Adding query filter params (interface=admin, service_id=51cce1192738465da2805a855f4ba4a1, region_id=RegionOne) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:21.540090 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e46ce-cc9c-4c09-9dd3-18e94fee5a07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:21.541625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e46ce-cc9c-4c09-9dd3-18e94fee5a07 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:21.552652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 482/974] 10.222.0.18 () {56 vars in 1249 bytes} [Mon Aug 22 15:38:21 2022] GET /identity/v3/endpoints?service_id=51cce1192738465da2805a855f4ba4a1&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:21.554198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e46ce-cc9c-4c09-9dd3-18e94fee5a07 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:21.587418 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f18813-2939-4afd-a903-0c87253c6ce3 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:21.629539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45366a6-7eaa-40fb-99ca-645c97dabd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:21.630504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45366a6-7eaa-40fb-99ca-645c97dabd9c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:21.630946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45366a6-7eaa-40fb-99ca-645c97dabd9c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:21.631399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45366a6-7eaa-40fb-99ca-645c97dabd9c None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:21.632397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45366a6-7eaa-40fb-99ca-645c97dabd9c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:21.632822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45366a6-7eaa-40fb-99ca-645c97dabd9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:21.634713 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45366a6-7eaa-40fb-99ca-645c97dabd9c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:21.648576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 493/975] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 15:38:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:21.649484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45366a6-7eaa-40fb-99ca-645c97dabd9c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:21.718524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:21.732203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e46ce-cc9c-4c09-9dd3-18e94fee5a07 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:21.752285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:21.764427 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45366a6-7eaa-40fb-99ca-645c97dabd9c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:21.773828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219639-d1be-4a36-b3ef-69167f0a1cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:21.774450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219639-d1be-4a36-b3ef-69167f0a1cf8 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:21.774725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219639-d1be-4a36-b3ef-69167f0a1cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:21.775123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d219639-d1be-4a36-b3ef-69167f0a1cf8 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:21.775902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d219639-d1be-4a36-b3ef-69167f0a1cf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:21.777443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d219639-d1be-4a36-b3ef-69167f0a1cf8 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:21.784005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 483/976] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 15:38:21 2022] GET /identity/v3/services => generated 1497 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:38:21.801839 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc93f7-5156-4d6d-9e9b-5fb505bc3d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:21.802500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc93f7-5156-4d6d-9e9b-5fb505bc3d43 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:21.803703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc93f7-5156-4d6d-9e9b-5fb505bc3d43 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:21.803703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc93f7-5156-4d6d-9e9b-5fb505bc3d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:21.815627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc93f7-5156-4d6d-9e9b-5fb505bc3d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:21.817355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc93f7-5156-4d6d-9e9b-5fb505bc3d43 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-28dc93f7-5156-4d6d-9e9b-5fb505bc3d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:21.836233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:21.837325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:21.838557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:21.838557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:21.838557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:21.838557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 494/977] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:21.843956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219639-d1be-4a36-b3ef-69167f0a1cf8 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:21.972930 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d219639-d1be-4a36-b3ef-69167f0a1cf8 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:22.018850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ce62c-f643-4681-a3d2-2214065b69e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:22.019473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ce62c-f643-4681-a3d2-2214065b69e3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:22.019751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ce62c-f643-4681-a3d2-2214065b69e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:22.020046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ce62c-f643-4681-a3d2-2214065b69e3 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:22.020722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ce62c-f643-4681-a3d2-2214065b69e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:22.021057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ce62c-f643-4681-a3d2-2214065b69e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:22.022612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ce62c-f643-4681-a3d2-2214065b69e3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:22.040600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 484/978] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:22.042297 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc93f7-5156-4d6d-9e9b-5fb505bc3d43 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:22.164774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc93f7-5156-4d6d-9e9b-5fb505bc3d43 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:22.201419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ada707-ebf6-44c5-a70c-c11d2c5a915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:22.202059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ada707-ebf6-44c5-a70c-c11d2c5a915c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:22.202400 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ada707-ebf6-44c5-a70c-c11d2c5a915c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:22.202678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ada707-ebf6-44c5-a70c-c11d2c5a915c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:22.211044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ada707-ebf6-44c5-a70c-c11d2c5a915c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:22.212855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ada707-ebf6-44c5-a70c-c11d2c5a915c None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:22.215856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-86ada707-ebf6-44c5-a70c-c11d2c5a915c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:22.226760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:22.233694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:22.235364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 495/979] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 15:38:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:22.236238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c34b-bfc2-4446-be2d-3e8c89bf7bed None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:22.236238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c34b-bfc2-4446-be2d-3e8c89bf7bed None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:22.236238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c34b-bfc2-4446-be2d-3e8c89bf7bed None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:22.236238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 485/980] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:22.238087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ada707-ebf6-44c5-a70c-c11d2c5a915c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:22.238618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86379038-658a-491e-aa2a-16a27bbbbbad None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:22.239076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86379038-658a-491e-aa2a-16a27bbbbbad None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:22.239429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86379038-658a-491e-aa2a-16a27bbbbbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:22.259716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-86379038-658a-491e-aa2a-16a27bbbbbad None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:22.261230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-86379038-658a-491e-aa2a-16a27bbbbbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:22.277570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:22.343722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 486/981] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:22.365046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ada707-ebf6-44c5-a70c-c11d2c5a915c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:22.400984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727cfab-cc1e-4f37-9d6d-41afa0ca3448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:22.402005 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727cfab-cc1e-4f37-9d6d-41afa0ca3448 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:22.402487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727cfab-cc1e-4f37-9d6d-41afa0ca3448 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:22.402959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727cfab-cc1e-4f37-9d6d-41afa0ca3448 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:22.403907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727cfab-cc1e-4f37-9d6d-41afa0ca3448 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:22.404486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727cfab-cc1e-4f37-9d6d-41afa0ca3448 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:22.406158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727cfab-cc1e-4f37-9d6d-41afa0ca3448 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:22.426053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 496/982] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 15:38:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:22.431823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86379038-658a-491e-aa2a-16a27bbbbbad None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:22.539340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86379038-658a-491e-aa2a-16a27bbbbbad None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:22.575004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7a64d-8baa-4b54-b147-e8fa568470a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:22.575695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7a64d-8baa-4b54-b147-e8fa568470a0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:22.576041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7a64d-8baa-4b54-b147-e8fa568470a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:22.576314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7a64d-8baa-4b54-b147-e8fa568470a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:22.594706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:22.618640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727cfab-cc1e-4f37-9d6d-41afa0ca3448 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:22.653494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7a64d-8baa-4b54-b147-e8fa568470a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:22.655095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7a64d-8baa-4b54-b147-e8fa568470a0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:22.684575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:22.743564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727cfab-cc1e-4f37-9d6d-41afa0ca3448 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:22.782590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebddec-71d4-424e-ba28-c532a9ef43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:22.783215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebddec-71d4-424e-ba28-c532a9ef43a1 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:22.783500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebddec-71d4-424e-ba28-c532a9ef43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:22.783778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebddec-71d4-424e-ba28-c532a9ef43a1 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:22.784440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebddec-71d4-424e-ba28-c532a9ef43a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:22.785859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebddec-71d4-424e-ba28-c532a9ef43a1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:22.788850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 487/983] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:22 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:38:22.794336 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7a64d-8baa-4b54-b147-e8fa568470a0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:22.844474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:22.897754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7a64d-8baa-4b54-b147-e8fa568470a0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:22.907373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 497/984] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:38:22 2022] POST /identity/v3/services => generated 242 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:38:22.948950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081805c-8665-4d8f-a741-72c576a0d9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:22.949610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081805c-8665-4d8f-a741-72c576a0d9ac None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:22.949893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081805c-8665-4d8f-a741-72c576a0d9ac None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:22.950168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081805c-8665-4d8f-a741-72c576a0d9ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:22.967009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081805c-8665-4d8f-a741-72c576a0d9ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:22.968718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081805c-8665-4d8f-a741-72c576a0d9ac None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-e081805c-8665-4d8f-a741-72c576a0d9ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:22.986245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:22.987528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:22.988977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:22.988977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:22.988977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:22.989404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 488/985] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:22.994893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebddec-71d4-424e-ba28-c532a9ef43a1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:23.117572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebddec-71d4-424e-ba28-c532a9ef43a1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:23.136846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:23.154414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fa2b6-b724-4c93-ac4a-f11e122f50ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:23.155042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa2b6-b724-4c93-ac4a-f11e122f50ec None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:23.172022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa2b6-b724-4c93-ac4a-f11e122f50ec None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:23.172022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa2b6-b724-4c93-ac4a-f11e122f50ec None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:23.172022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fa2b6-b724-4c93-ac4a-f11e122f50ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:23.172022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fa2b6-b724-4c93-ac4a-f11e122f50ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:23.172022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fa2b6-b724-4c93-ac4a-f11e122f50ec None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:23.172022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 498/986] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:23.177760 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081805c-8665-4d8f-a741-72c576a0d9ac None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:23.283440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:23.290656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081805c-8665-4d8f-a741-72c576a0d9ac None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:23.325284 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120b4d-d05e-4c1a-8412-ce93cbf6de81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:23.325967 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120b4d-d05e-4c1a-8412-ce93cbf6de81 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:23.326278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120b4d-d05e-4c1a-8412-ce93cbf6de81 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:23.326553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58120b4d-d05e-4c1a-8412-ce93cbf6de81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:23.333560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58120b4d-d05e-4c1a-8412-ce93cbf6de81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:23.335545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58120b4d-d05e-4c1a-8412-ce93cbf6de81 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-58120b4d-d05e-4c1a-8412-ce93cbf6de81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:23.349303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:23.350917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:23.351875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:23.351875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:23.351875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:23.351875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:23.351875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:23.351875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:23.351875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:23.351875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:23.356637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 489/987] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:23.358466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fa2b6-b724-4c93-ac4a-f11e122f50ec None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:23.466481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fa2b6-b724-4c93-ac4a-f11e122f50ec None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:23.503907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6abbe-a1f3-47c2-b201-db99a0ef6965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:23.504541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6abbe-a1f3-47c2-b201-db99a0ef6965 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:23.504840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6abbe-a1f3-47c2-b201-db99a0ef6965 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:23.505115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6abbe-a1f3-47c2-b201-db99a0ef6965 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:23.505815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6abbe-a1f3-47c2-b201-db99a0ef6965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:23.506138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6abbe-a1f3-47c2-b201-db99a0ef6965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:23.507653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6abbe-a1f3-47c2-b201-db99a0ef6965 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:23.520720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 499/988] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:38:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:23.527474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120b4d-d05e-4c1a-8412-ce93cbf6de81 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:23.667345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58120b4d-d05e-4c1a-8412-ce93cbf6de81 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:23.685042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce485a39-0033-478b-8ad6-9eee56cbc2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:23.685662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce485a39-0033-478b-8ad6-9eee56cbc2d0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:23.685938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce485a39-0033-478b-8ad6-9eee56cbc2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:23.686250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce485a39-0033-478b-8ad6-9eee56cbc2d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:23.686935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce485a39-0033-478b-8ad6-9eee56cbc2d0 None admin] RBAC: Adding query filter params (role.id=bd1525385a604a11ae4a956f07a384b9, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=3f087c40f6514c3a84a4131bc5585fea) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:23.687238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce485a39-0033-478b-8ad6-9eee56cbc2d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:23.689000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce485a39-0033-478b-8ad6-9eee56cbc2d0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:23.696270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 490/989] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:23 2022] GET /identity/v3/role_assignments?user.id=3f087c40f6514c3a84a4131bc5585fea&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=bd1525385a604a11ae4a956f07a384b9 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:23.752378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e6f33-7d72-4f1a-97ab-e68ec03e7f25 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:23.752757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e6f33-7d72-4f1a-97ab-e68ec03e7f25 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:23.752953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e6f33-7d72-4f1a-97ab-e68ec03e7f25 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:23.754694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 500/990] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:23.760957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fa171-0fc7-49d8-a833-b4f498b4c4bb None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:23.761307 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fa171-0fc7-49d8-a833-b4f498b4c4bb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:23.761602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fa171-0fc7-49d8-a833-b4f498b4c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:23.782117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d63fa171-0fc7-49d8-a833-b4f498b4c4bb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:23.783342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d63fa171-0fc7-49d8-a833-b4f498b4c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:23.800538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:23.863308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 491/991] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:24.133392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e6f33-7d72-4f1a-97ab-e68ec03e7f25 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:24.179172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:24.243579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e6f33-7d72-4f1a-97ab-e68ec03e7f25 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:24.279241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f004c8-d52b-4404-8db5-3d1e10d96407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:24.280158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f004c8-d52b-4404-8db5-3d1e10d96407 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:24.280605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f004c8-d52b-4404-8db5-3d1e10d96407 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:24.281070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f004c8-d52b-4404-8db5-3d1e10d96407 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:24.281790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f004c8-d52b-4404-8db5-3d1e10d96407 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:24.283306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f004c8-d52b-4404-8db5-3d1e10d96407 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-c7f004c8-d52b-4404-8db5-3d1e10d96407 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:24.292637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:24.293737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:24.294977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 501/992] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 15:38:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:24.300532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fa171-0fc7-49d8-a833-b4f498b4c4bb None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:24.406123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fa171-0fc7-49d8-a833-b4f498b4c4bb None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:24.443497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7a8b-3481-4917-b125-0dc43fd959fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:24.444137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7a8b-3481-4917-b125-0dc43fd959fd None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:24.444410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7a8b-3481-4917-b125-0dc43fd959fd None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:24.444700 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7a8b-3481-4917-b125-0dc43fd959fd None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:24.445331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7a8b-3481-4917-b125-0dc43fd959fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:24.445629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7a8b-3481-4917-b125-0dc43fd959fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:24.446983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7a8b-3481-4917-b125-0dc43fd959fd None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:24.452324 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 492/993] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 15:38:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:24.457767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f004c8-d52b-4404-8db5-3d1e10d96407 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:24.568309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f004c8-d52b-4404-8db5-3d1e10d96407 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:24.570719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:24.606539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f70fa-b048-4d8a-b51b-a2e3c6f9c378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:24.607176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f70fa-b048-4d8a-b51b-a2e3c6f9c378 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:24.607460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f70fa-b048-4d8a-b51b-a2e3c6f9c378 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:24.607756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f70fa-b048-4d8a-b51b-a2e3c6f9c378 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:24.608487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f70fa-b048-4d8a-b51b-a2e3c6f9c378 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:24.609050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f70fa-b048-4d8a-b51b-a2e3c6f9c378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:24.610452 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f70fa-b048-4d8a-b51b-a2e3c6f9c378 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:24.621251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 502/994] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 15:38:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:24.622716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7a8b-3481-4917-b125-0dc43fd959fd None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:24.641008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:24.732345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7a8b-3481-4917-b125-0dc43fd959fd None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:24.768981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef936b-e94e-4629-b6eb-606d71426371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:24.769595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef936b-e94e-4629-b6eb-606d71426371 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:24.769867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef936b-e94e-4629-b6eb-606d71426371 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:24.770135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef936b-e94e-4629-b6eb-606d71426371 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:24.770851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef936b-e94e-4629-b6eb-606d71426371 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:24.772801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef936b-e94e-4629-b6eb-606d71426371 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:24.859058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 493/995] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:38:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:38:24.901751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66db76-9458-4247-b2d7-04a542c8fe5c None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:24.902216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66db76-9458-4247-b2d7-04a542c8fe5c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:24.902594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66db76-9458-4247-b2d7-04a542c8fe5c None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:24.904116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 503/996] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:24.911810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e8c84-18ac-4f2e-be1c-b0c99cc9aee9 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:24.912140 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e8c84-18ac-4f2e-be1c-b0c99cc9aee9 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:24.912419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e8c84-18ac-4f2e-be1c-b0c99cc9aee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:24.938425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-cd8e8c84-18ac-4f2e-be1c-b0c99cc9aee9 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:24.939829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-cd8e8c84-18ac-4f2e-be1c-b0c99cc9aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:25.057116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:25.063784 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 494/997] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:25.336059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66db76-9458-4247-b2d7-04a542c8fe5c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:25.474148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66db76-9458-4247-b2d7-04a542c8fe5c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:25.512256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02104e5f-af4a-4d45-b868-25fa118fb6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:25.513233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02104e5f-af4a-4d45-b868-25fa118fb6a9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:25.513682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02104e5f-af4a-4d45-b868-25fa118fb6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:25.514121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02104e5f-af4a-4d45-b868-25fa118fb6a9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:25.514849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02104e5f-af4a-4d45-b868-25fa118fb6a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:25.516378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02104e5f-af4a-4d45-b868-25fa118fb6a9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-02104e5f-af4a-4d45-b868-25fa118fb6a9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:25.525726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:25.527003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:38:25.528090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:25.530501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 504/998] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:25.536384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e8c84-18ac-4f2e-be1c-b0c99cc9aee9 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:25.655143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e8c84-18ac-4f2e-be1c-b0c99cc9aee9 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:25.698968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96649c23-0239-426a-93d4-6bf718021b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:25.699585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96649c23-0239-426a-93d4-6bf718021b88 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:25.699858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96649c23-0239-426a-93d4-6bf718021b88 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:25.700163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96649c23-0239-426a-93d4-6bf718021b88 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:25.700822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96649c23-0239-426a-93d4-6bf718021b88 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:25.706181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96649c23-0239-426a-93d4-6bf718021b88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:25.706181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96649c23-0239-426a-93d4-6bf718021b88 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:25.713478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 495/999] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:38:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:25.715397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02104e5f-af4a-4d45-b868-25fa118fb6a9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:25.754991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:25.823655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5f177-33fe-4331-99ff-5e845ac1a209 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:25.824224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5f177-33fe-4331-99ff-5e845ac1a209 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:25.824464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5f177-33fe-4331-99ff-5e845ac1a209 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:25.828580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 496/1000] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:38:25.833419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd215-aed9-42ce-b567-37c069f89c6d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:25.833795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd215-aed9-42ce-b567-37c069f89c6d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:25.834264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd215-aed9-42ce-b567-37c069f89c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:25.839403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02104e5f-af4a-4d45-b868-25fa118fb6a9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:25.860444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-fa7bd215-aed9-42ce-b567-37c069f89c6d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:25.862253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fa7bd215-aed9-42ce-b567-37c069f89c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:25.885431 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828ae4e-29bd-42bf-b66a-da2374a57545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:25.886122 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ae4e-29bd-42bf-b66a-da2374a57545 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:25.886454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ae4e-29bd-42bf-b66a-da2374a57545 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:25.886733 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828ae4e-29bd-42bf-b66a-da2374a57545 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:25.887373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828ae4e-29bd-42bf-b66a-da2374a57545 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:25.887676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828ae4e-29bd-42bf-b66a-da2374a57545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:25.889098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828ae4e-29bd-42bf-b66a-da2374a57545 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:25.899568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 505/1001] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:38:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:25.901616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828ae4e-29bd-42bf-b66a-da2374a57545 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:25.957257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:25.984645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 497/1002] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:26.023718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:26.030619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828ae4e-29bd-42bf-b66a-da2374a57545 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:26.067719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bbb5a-3453-4952-8619-c60203ce87a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:26.068341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bbb5a-3453-4952-8619-c60203ce87a5 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:26.068669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bbb5a-3453-4952-8619-c60203ce87a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:26.068942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bbb5a-3453-4952-8619-c60203ce87a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:26.069645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bbb5a-3453-4952-8619-c60203ce87a5 None admin] RBAC: Adding query filter params (interface=public, service_id=fc72ad5477574bf19da94a41030fe217, region_id=RegionOne) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:26.069953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bbb5a-3453-4952-8619-c60203ce87a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:26.071322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bbb5a-3453-4952-8619-c60203ce87a5 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:26.077621 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 506/1003] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 15:38:25 2022] GET /identity/v3/endpoints?service_id=fc72ad5477574bf19da94a41030fe217&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:26.084109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bd215-aed9-42ce-b567-37c069f89c6d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:26.218606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bd215-aed9-42ce-b567-37c069f89c6d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:26.262597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a1674-69ef-4ed0-8501-3b3f350e6d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:26.263328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a1674-69ef-4ed0-8501-3b3f350e6d13 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:26.263674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a1674-69ef-4ed0-8501-3b3f350e6d13 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:26.264010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a1674-69ef-4ed0-8501-3b3f350e6d13 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:26.264766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a1674-69ef-4ed0-8501-3b3f350e6d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:26.266201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a1674-69ef-4ed0-8501-3b3f350e6d13 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:26.274349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 498/1004] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 15:38:26 2022] GET /identity/v3/services => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:38:26.297575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bbb5a-3453-4952-8619-c60203ce87a5 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:26.455580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bbb5a-3453-4952-8619-c60203ce87a5 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:26.507044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15177d57-b673-419f-84c4-f045784b48a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:26.507730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15177d57-b673-419f-84c4-f045784b48a9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:26.508007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15177d57-b673-419f-84c4-f045784b48a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:26.508279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15177d57-b673-419f-84c4-f045784b48a9 None admin] PATH_INFO: `/v3/services/image` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:26.508909 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15177d57-b673-419f-84c4-f045784b48a9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:26.510340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15177d57-b673-419f-84c4-f045784b48a9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-15177d57-b673-419f-84c4-f045784b48a9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:26.520924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:26.523288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:26.526033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 507/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Aug 22 15:38:26 2022] GET /identity/v3/services/image => generated 86 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:26.530021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a1674-69ef-4ed0-8501-3b3f350e6d13 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:26.602970 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:26.654676 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a1674-69ef-4ed0-8501-3b3f350e6d13 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:26.694625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732ffbc-f288-4da1-a0e3-e530afee83b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:26.695493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732ffbc-f288-4da1-a0e3-e530afee83b5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:26.696078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732ffbc-f288-4da1-a0e3-e530afee83b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:26.696501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732ffbc-f288-4da1-a0e3-e530afee83b5 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:26.697446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732ffbc-f288-4da1-a0e3-e530afee83b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:26.697902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732ffbc-f288-4da1-a0e3-e530afee83b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:26.699425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732ffbc-f288-4da1-a0e3-e530afee83b5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:26.705520 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 499/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:26.712618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15177d57-b673-419f-84c4-f045784b48a9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:26.743090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:26.854135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15177d57-b673-419f-84c4-f045784b48a9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:26.907917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cee05-3fd6-4968-8df2-3384ded07a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:26.909239 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cee05-3fd6-4968-8df2-3384ded07a85 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:26.909886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cee05-3fd6-4968-8df2-3384ded07a85 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:26.910515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cee05-3fd6-4968-8df2-3384ded07a85 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:26.911718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cee05-3fd6-4968-8df2-3384ded07a85 None admin] RBAC: Adding query filter params (type=image) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:26.912954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cee05-3fd6-4968-8df2-3384ded07a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:26.915322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cee05-3fd6-4968-8df2-3384ded07a85 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:26.925510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 508/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:27.065408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7137cc-fba5-4367-82e9-bfb15620992c None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:27.066159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7137cc-fba5-4367-82e9-bfb15620992c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:27.066159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7137cc-fba5-4367-82e9-bfb15620992c None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:27.067611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 500/1008] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:38:27.073612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d3c1-c803-429c-bcb1-dddfeb0c82cb None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:27.073857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d3c1-c803-429c-bcb1-dddfeb0c82cb None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:27.075388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d3c1-c803-429c-bcb1-dddfeb0c82cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:27.094115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-91c3d3c1-c803-429c-bcb1-dddfeb0c82cb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:27.095352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-91c3d3c1-c803-429c-bcb1-dddfeb0c82cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:27.183154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 509/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:27.454166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7137cc-fba5-4367-82e9-bfb15620992c None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:27.566667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7137cc-fba5-4367-82e9-bfb15620992c None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:27.593532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:27.605723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7821a-8309-49bd-9d41-94a474c462a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:27.606370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7821a-8309-49bd-9d41-94a474c462a2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:27.606657 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7821a-8309-49bd-9d41-94a474c462a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:27.606959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7821a-8309-49bd-9d41-94a474c462a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:27.608092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7821a-8309-49bd-9d41-94a474c462a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:27.609557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7821a-8309-49bd-9d41-94a474c462a2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:27.611332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 501/1010] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:27.617439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d3c1-c803-429c-bcb1-dddfeb0c82cb None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:27.637335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:27.730023 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d3c1-c803-429c-bcb1-dddfeb0c82cb None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:27.767602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f8c4-9dae-4361-8ca0-19d8ec279be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:27.768224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f8c4-9dae-4361-8ca0-19d8ec279be1 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:27.768504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f8c4-9dae-4361-8ca0-19d8ec279be1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:27.768805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f8c4-9dae-4361-8ca0-19d8ec279be1 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:27.769571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478f8c4-9dae-4361-8ca0-19d8ec279be1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:27.770957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478f8c4-9dae-4361-8ca0-19d8ec279be1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:27.876050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 510/1011] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:38:27 2022] POST /identity/v3/projects => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:38:28.306955 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c099-029e-4cc9-82ba-82c8952f1593 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:28.307570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c099-029e-4cc9-82ba-82c8952f1593 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:28.307674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c099-029e-4cc9-82ba-82c8952f1593 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:28.309218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 502/1012] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:28.314896 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e64f-8c68-44e6-9969-b900169848e3 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:28.315207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e64f-8c68-44e6-9969-b900169848e3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:28.315438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e64f-8c68-44e6-9969-b900169848e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:28.337347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-8c78e64f-8c68-44e6-9969-b900169848e3 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:28.338614 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8c78e64f-8c68-44e6-9969-b900169848e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:28.410837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:28.420252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 511/1013] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:28.695003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21c099-029e-4cc9-82ba-82c8952f1593 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:28.818629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21c099-029e-4cc9-82ba-82c8952f1593 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:28.860176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4899d12-6d5c-45f5-bbd8-61165ee53535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:28.860887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4899d12-6d5c-45f5-bbd8-61165ee53535 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:28.861166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4899d12-6d5c-45f5-bbd8-61165ee53535 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:28.861441 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4899d12-6d5c-45f5-bbd8-61165ee53535 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:28.862016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4899d12-6d5c-45f5-bbd8-61165ee53535 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:28.863392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4899d12-6d5c-45f5-bbd8-61165ee53535 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-d4899d12-6d5c-45f5-bbd8-61165ee53535 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:28.876709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:28.877811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:28.879397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 503/1014] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:28.884864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78e64f-8c68-44e6-9969-b900169848e3 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:29.004405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2068c4-f48a-4fc3-a9ed-5ab643f3ea37 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:29.004736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2068c4-f48a-4fc3-a9ed-5ab643f3ea37 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:29.005016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2068c4-f48a-4fc3-a9ed-5ab643f3ea37 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:29.006977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 504/1015] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:29.010172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78e64f-8c68-44e6-9969-b900169848e3 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:29.012506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a12853-aec8-410f-821f-6d2d6915b62d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:29.012817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a12853-aec8-410f-821f-6d2d6915b62d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:29.013093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a12853-aec8-410f-821f-6d2d6915b62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:29.032822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-14a12853-aec8-410f-821f-6d2d6915b62d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:29.034077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-14a12853-aec8-410f-821f-6d2d6915b62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:29.051863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa585fa-9cec-417f-bfda-3bf4f55fe31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:29.052616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa585fa-9cec-417f-bfda-3bf4f55fe31b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:29.052931 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa585fa-9cec-417f-bfda-3bf4f55fe31b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:29.053289 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa585fa-9cec-417f-bfda-3bf4f55fe31b None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:29.054015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa585fa-9cec-417f-bfda-3bf4f55fe31b None admin] RBAC: Adding query filter params (name=compute) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:29.054426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa585fa-9cec-417f-bfda-3bf4f55fe31b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:29.055903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa585fa-9cec-417f-bfda-3bf4f55fe31b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:29.066541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 512/1016] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:38:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:29.067750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa585fa-9cec-417f-bfda-3bf4f55fe31b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:29.100682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:29.118875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 505/1017] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:29 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:29.151257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:29.196527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa585fa-9cec-417f-bfda-3bf4f55fe31b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:29.243238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3917e6-1e5d-4cd4-b4b3-733a32877597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:29.243847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3917e6-1e5d-4cd4-b4b3-733a32877597 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:29.244121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3917e6-1e5d-4cd4-b4b3-733a32877597 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:29.244388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3917e6-1e5d-4cd4-b4b3-733a32877597 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:29.245206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3917e6-1e5d-4cd4-b4b3-733a32877597 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:29.245505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3917e6-1e5d-4cd4-b4b3-733a32877597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:29.246926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3917e6-1e5d-4cd4-b4b3-733a32877597 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:29.252426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 513/1018] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 15:38:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:29.258510 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a12853-aec8-410f-821f-6d2d6915b62d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:29.374685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a12853-aec8-410f-821f-6d2d6915b62d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:29.390273 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3917e6-1e5d-4cd4-b4b3-733a32877597 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:29.422032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e91be-dda0-40fd-803a-82ab853b9ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:29.422969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e91be-dda0-40fd-803a-82ab853b9ee6 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:29.423432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e91be-dda0-40fd-803a-82ab853b9ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:29.424116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e91be-dda0-40fd-803a-82ab853b9ee6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:29.425253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e91be-dda0-40fd-803a-82ab853b9ee6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:29.426913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e91be-dda0-40fd-803a-82ab853b9ee6 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:29.502521 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3917e6-1e5d-4cd4-b4b3-733a32877597 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:29.529566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:29.538665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b8241-dfb8-4042-8a9a-e0ee6fa36e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:29.539286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b8241-dfb8-4042-8a9a-e0ee6fa36e54 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:29.539557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b8241-dfb8-4042-8a9a-e0ee6fa36e54 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:29.539824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b8241-dfb8-4042-8a9a-e0ee6fa36e54 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:29.540466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b8241-dfb8-4042-8a9a-e0ee6fa36e54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:29.542157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b8241-dfb8-4042-8a9a-e0ee6fa36e54 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:29.582498 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 506/1019] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:38:29 2022] POST /identity/v3/endpoints => generated 334 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:38:29.671559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 514/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:38:29 2022] POST /identity/v3/services => generated 242 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:38:29.922169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d718a7-ac10-476f-81af-08b36f7c61af None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:29.922341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d718a7-ac10-476f-81af-08b36f7c61af None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:29.922613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d718a7-ac10-476f-81af-08b36f7c61af None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:29.924557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 507/1021] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:29.929966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d781e-2ffb-4fc2-aef4-3f3e8e5fe542 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:29.930444 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d781e-2ffb-4fc2-aef4-3f3e8e5fe542 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:29.930633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d781e-2ffb-4fc2-aef4-3f3e8e5fe542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:29.951121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-793d781e-2ffb-4fc2-aef4-3f3e8e5fe542 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:29.952338 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-793d781e-2ffb-4fc2-aef4-3f3e8e5fe542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:30.046242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 515/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:30.324770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d718a7-ac10-476f-81af-08b36f7c61af None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:30.371480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:30.441595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d718a7-ac10-476f-81af-08b36f7c61af None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:30.484662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66ec1c-c536-4222-96d0-c8a60d7a91bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:30.485330 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66ec1c-c536-4222-96d0-c8a60d7a91bb None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:30.485610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66ec1c-c536-4222-96d0-c8a60d7a91bb None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:30.485879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66ec1c-c536-4222-96d0-c8a60d7a91bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:30.487039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66ec1c-c536-4222-96d0-c8a60d7a91bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:30.488484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66ec1c-c536-4222-96d0-c8a60d7a91bb None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:30.490256 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 508/1023] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:30.496540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d781e-2ffb-4fc2-aef4-3f3e8e5fe542 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:30.629407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d781e-2ffb-4fc2-aef4-3f3e8e5fe542 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:30.644100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:30.671471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd3ab7-8d0b-48ba-b8cf-9561cabf61d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:30.672438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3ab7-8d0b-48ba-b8cf-9561cabf61d9 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:30.673060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3ab7-8d0b-48ba-b8cf-9561cabf61d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:30.673528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd3ab7-8d0b-48ba-b8cf-9561cabf61d9 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:30.674799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd3ab7-8d0b-48ba-b8cf-9561cabf61d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:30.677115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd3ab7-8d0b-48ba-b8cf-9561cabf61d9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:30.847699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 516/1024] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:38:30 2022] POST /identity/v3/users => generated 285 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:38:31.717328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca152-5ec6-435e-a8a9-5431b5861876 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:31.717858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca152-5ec6-435e-a8a9-5431b5861876 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:31.717858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca152-5ec6-435e-a8a9-5431b5861876 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:31.719360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 509/1025] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:31.724986 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3473d-693c-48e5-8abe-cd4f57c0dc79 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:31.725494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3473d-693c-48e5-8abe-cd4f57c0dc79 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:31.725577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3473d-693c-48e5-8abe-cd4f57c0dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:31.745567 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-a0d3473d-693c-48e5-8abe-cd4f57c0dc79 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:31.746813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a0d3473d-693c-48e5-8abe-cd4f57c0dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:31.788233 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bc6d7-dd5d-425d-8008-e6f0c247bc3e None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:31.788712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bc6d7-dd5d-425d-8008-e6f0c247bc3e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:31.788882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bc6d7-dd5d-425d-8008-e6f0c247bc3e None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:31.790610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 510/1026] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:38:31.796497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fec0d-6b8f-4e47-8aa9-75a06b0449e4 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:31.796854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fec0d-6b8f-4e47-8aa9-75a06b0449e4 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:31.797150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fec0d-6b8f-4e47-8aa9-75a06b0449e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:31.816395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-269fec0d-6b8f-4e47-8aa9-75a06b0449e4 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:31.817651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-269fec0d-6b8f-4e47-8aa9-75a06b0449e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:31.833773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 517/1027] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:31.904579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 511/1028] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:32.120289 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3473d-693c-48e5-8abe-cd4f57c0dc79 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:32.189444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fec0d-6b8f-4e47-8aa9-75a06b0449e4 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:32.237430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:32.247086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:32.251422 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3473d-693c-48e5-8abe-cd4f57c0dc79 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:32.289811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7e352-cf0d-42f1-8824-76220806e117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:32.290424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e352-cf0d-42f1-8824-76220806e117 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:32.290708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e352-cf0d-42f1-8824-76220806e117 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:32.290974 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e352-cf0d-42f1-8824-76220806e117 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:32.302240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7e352-cf0d-42f1-8824-76220806e117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-75d7e352-cf0d-42f1-8824-76220806e117 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:32.307695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:32.308777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:32.310116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 518/1029] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 15:38:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:32.315064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fec0d-6b8f-4e47-8aa9-75a06b0449e4 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:32.318224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7e352-cf0d-42f1-8824-76220806e117 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:32.358184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae800-736d-47a1-a683-72ea45374083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:32.359186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae800-736d-47a1-a683-72ea45374083 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:32.359463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae800-736d-47a1-a683-72ea45374083 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:32.359728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae800-736d-47a1-a683-72ea45374083 None admin] PATH_INFO: `/v3/services/image` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:32.360320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae800-736d-47a1-a683-72ea45374083 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:32.361746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae800-736d-47a1-a683-72ea45374083 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-bcaae800-736d-47a1-a683-72ea45374083 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:32.371833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:32.372963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:32.374165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 512/1030] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Aug 22 15:38:32 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:32.379002 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae800-736d-47a1-a683-72ea45374083 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:32.440952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7e352-cf0d-42f1-8824-76220806e117 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:32.487628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd33729-0e9d-4bb2-aba3-4c0984022ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:32.488719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd33729-0e9d-4bb2-aba3-4c0984022ecf None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:32.489151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd33729-0e9d-4bb2-aba3-4c0984022ecf None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:32.489584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd33729-0e9d-4bb2-aba3-4c0984022ecf None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:32.491263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd33729-0e9d-4bb2-aba3-4c0984022ecf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:32.491750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd33729-0e9d-4bb2-aba3-4c0984022ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:32.494232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd33729-0e9d-4bb2-aba3-4c0984022ecf None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:32.512780 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 519/1031] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 15:38:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:32.513014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae800-736d-47a1-a683-72ea45374083 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:32.513014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:32.515079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd33729-0e9d-4bb2-aba3-4c0984022ecf None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:32.541379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:32.566009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8635bf-772c-42e1-856d-564e894935f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:32.566643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8635bf-772c-42e1-856d-564e894935f7 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:32.566923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8635bf-772c-42e1-856d-564e894935f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:32.567209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8635bf-772c-42e1-856d-564e894935f7 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:32.567854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8635bf-772c-42e1-856d-564e894935f7 None admin] RBAC: Adding query filter params (name=image) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:32.568165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8635bf-772c-42e1-856d-564e894935f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:32.570366 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8635bf-772c-42e1-856d-564e894935f7 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:32.580574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 513/1032] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:32.582341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8635bf-772c-42e1-856d-564e894935f7 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:32.667860 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd33729-0e9d-4bb2-aba3-4c0984022ecf None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:32.709248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1507-2692-46a6-95d0-fb02c8b6021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:32.709901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1507-2692-46a6-95d0-fb02c8b6021d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:32.710186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1507-2692-46a6-95d0-fb02c8b6021d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:32.710436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1507-2692-46a6-95d0-fb02c8b6021d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:32.718511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8635bf-772c-42e1-856d-564e894935f7 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:32.727685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1507-2692-46a6-95d0-fb02c8b6021d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:32.729209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1507-2692-46a6-95d0-fb02c8b6021d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-cf7c1507-2692-46a6-95d0-fb02c8b6021d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:32.750477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:32.757674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:32.758775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:32.758775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:32.758775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:32.758775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 520/1033] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:32.762027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1507-2692-46a6-95d0-fb02c8b6021d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:32.781014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d51e32-4e27-49da-8774-8d76cd6ad77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:32.781722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d51e32-4e27-49da-8774-8d76cd6ad77b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:32.782004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d51e32-4e27-49da-8774-8d76cd6ad77b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:32.782267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d51e32-4e27-49da-8774-8d76cd6ad77b None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:32.782918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d51e32-4e27-49da-8774-8d76cd6ad77b None admin] RBAC: Adding query filter params (type=image) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:32.783218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d51e32-4e27-49da-8774-8d76cd6ad77b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:32.784654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d51e32-4e27-49da-8774-8d76cd6ad77b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:32.793776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 514/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:32.800268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d51e32-4e27-49da-8774-8d76cd6ad77b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:32.837544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:32.856459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:32.903791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1507-2692-46a6-95d0-fb02c8b6021d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:32.929020 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d51e32-4e27-49da-8774-8d76cd6ad77b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:32.948223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d546f-b819-471a-99bf-e3c86f085a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:32.948918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d546f-b819-471a-99bf-e3c86f085a60 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:32.949220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d546f-b819-471a-99bf-e3c86f085a60 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:32.949530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d546f-b819-471a-99bf-e3c86f085a60 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:32.950192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d546f-b819-471a-99bf-e3c86f085a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:32.950630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d546f-b819-471a-99bf-e3c86f085a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:32.952004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d546f-b819-471a-99bf-e3c86f085a60 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:32.965027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 521/1035] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:32.966163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f7c88-e501-40b8-a001-2bba741160a0 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:32.966301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5ebb6-32a3-4e66-8765-c6e464f3387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:32.966490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f7c88-e501-40b8-a001-2bba741160a0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:32.966710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f7c88-e501-40b8-a001-2bba741160a0 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:32.966809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ebb6-32a3-4e66-8765-c6e464f3387d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:32.967087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ebb6-32a3-4e66-8765-c6e464f3387d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:32.967356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5ebb6-32a3-4e66-8765-c6e464f3387d None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:32.968148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 522/1036] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:32.968263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5ebb6-32a3-4e66-8765-c6e464f3387d None admin] RBAC: Adding query filter params (interface=public, service_id=7775df0ca0644ae28256f7746a26a83c, region_id=RegionOne) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:32.968431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5ebb6-32a3-4e66-8765-c6e464f3387d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:32.969914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5ebb6-32a3-4e66-8765-c6e464f3387d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:32.973061 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f7c88-e501-40b8-a001-2bba741160a0 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:32.976479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 515/1037] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 15:38:32 2022] GET /identity/v3/endpoints?service_id=7775df0ca0644ae28256f7746a26a83c&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:32.977559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3b660-e9f2-4ecb-9b03-e925b8fba5ce None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:32.977846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3b660-e9f2-4ecb-9b03-e925b8fba5ce None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:32.978116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3b660-e9f2-4ecb-9b03-e925b8fba5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:32.998309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-30c3b660-e9f2-4ecb-9b03-e925b8fba5ce None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:32.999541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-30c3b660-e9f2-4ecb-9b03-e925b8fba5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:33.080213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 516/1038] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:33.081175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3b660-e9f2-4ecb-9b03-e925b8fba5ce None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:33.105070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f7c88-e501-40b8-a001-2bba741160a0 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:33.119110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:33.140659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:33.146042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36c271-4afd-4cd8-a89a-13097766dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:33.149744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c271-4afd-4cd8-a89a-13097766dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:33.149744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c271-4afd-4cd8-a89a-13097766dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:33.149744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36c271-4afd-4cd8-a89a-13097766dfe2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:33.158432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36c271-4afd-4cd8-a89a-13097766dfe2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:33.160076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36c271-4afd-4cd8-a89a-13097766dfe2 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-4a36c271-4afd-4cd8-a89a-13097766dfe2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:33.173117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:33.174432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:33.175946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 523/1039] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 15:38:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:33.183041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36c271-4afd-4cd8-a89a-13097766dfe2 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:33.223809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3b660-e9f2-4ecb-9b03-e925b8fba5ce None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:33.266752 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48567-b657-46c9-beee-416614f4d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:33.267777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48567-b657-46c9-beee-416614f4d035 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:33.268244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48567-b657-46c9-beee-416614f4d035 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:33.268771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce48567-b657-46c9-beee-416614f4d035 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:33.269593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce48567-b657-46c9-beee-416614f4d035 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:33.271045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce48567-b657-46c9-beee-416614f4d035 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:33.278699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 517/1040] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 15:38:33 2022] GET /identity/v3/services => generated 1957 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:38:33.340933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36c271-4afd-4cd8-a89a-13097766dfe2 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:33.407444 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917e8f-da76-4898-8de8-0622dc172ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:33.408413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917e8f-da76-4898-8de8-0622dc172ac2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:33.408860 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917e8f-da76-4898-8de8-0622dc172ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:33.409257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a917e8f-da76-4898-8de8-0622dc172ac2 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:33.410625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a917e8f-da76-4898-8de8-0622dc172ac2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:33.411120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a917e8f-da76-4898-8de8-0622dc172ac2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:33.413897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a917e8f-da76-4898-8de8-0622dc172ac2 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:33.430348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48567-b657-46c9-beee-416614f4d035 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:33.444594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 524/1041] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 15:38:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:33.450351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917e8f-da76-4898-8de8-0622dc172ac2 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:33.511766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:33.548122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:33.564266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce48567-b657-46c9-beee-416614f4d035 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:33.572497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a917e8f-da76-4898-8de8-0622dc172ac2 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:33.609464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4f788-0b48-4689-9122-3940124e7939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:33.610112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4f788-0b48-4689-9122-3940124e7939 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:33.610377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4f788-0b48-4689-9122-3940124e7939 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:33.610648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4f788-0b48-4689-9122-3940124e7939 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:33.620985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da80c3-215e-4c00-a7ef-fc017dd8a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:33.621938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da80c3-215e-4c00-a7ef-fc017dd8a039 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:33.622343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da80c3-215e-4c00-a7ef-fc017dd8a039 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:33.622622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da80c3-215e-4c00-a7ef-fc017dd8a039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:33.622899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4f788-0b48-4689-9122-3940124e7939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-15a4f788-0b48-4689-9122-3940124e7939 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:33.628076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:33.629131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:33.634015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 518/1042] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:33.636572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4f788-0b48-4689-9122-3940124e7939 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:33.717719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da80c3-215e-4c00-a7ef-fc017dd8a039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:33.721240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da80c3-215e-4c00-a7ef-fc017dd8a039 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:33.758139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4f788-0b48-4689-9122-3940124e7939 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:33.783264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:33.801576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d43c28-b0d9-449e-9ca0-611c1baf4cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:33.802534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d43c28-b0d9-449e-9ca0-611c1baf4cb1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:33.802982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d43c28-b0d9-449e-9ca0-611c1baf4cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:33.803617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d43c28-b0d9-449e-9ca0-611c1baf4cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:33.804431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d43c28-b0d9-449e-9ca0-611c1baf4cb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:33.804973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d43c28-b0d9-449e-9ca0-611c1baf4cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:33.807883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d43c28-b0d9-449e-9ca0-611c1baf4cb1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:33.817098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 519/1043] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:33.823091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d43c28-b0d9-449e-9ca0-611c1baf4cb1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:33.836347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:33.853069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 525/1044] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:38:33.854997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da80c3-215e-4c00-a7ef-fc017dd8a039 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:33.954387 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d43c28-b0d9-449e-9ca0-611c1baf4cb1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:33.985635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da80c3-215e-4c00-a7ef-fc017dd8a039 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:34.010697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a85801-ff39-4466-9682-34b2dd617a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:34.011347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85801-ff39-4466-9682-34b2dd617a60 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:34.011624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85801-ff39-4466-9682-34b2dd617a60 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:34.011901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a85801-ff39-4466-9682-34b2dd617a60 None admin] PATH_INFO: `/v3/users/1ed7ebdd20a544d39e2fb2cf86083da7` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:34.027422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a85801-ff39-4466-9682-34b2dd617a60 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed7ebdd20a544d39e2fb2cf86083da7)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:34.028935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a85801-ff39-4466-9682-34b2dd617a60 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:34.030672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 520/1045] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:38:33 2022] GET /identity/v3/users/1ed7ebdd20a544d39e2fb2cf86083da7 => generated 285 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:34.035378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040da463-f852-4dde-9297-c5b098403280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:34.036266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040da463-f852-4dde-9297-c5b098403280 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:34.036718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040da463-f852-4dde-9297-c5b098403280 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:34.036946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a85801-ff39-4466-9682-34b2dd617a60 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:34.037851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040da463-f852-4dde-9297-c5b098403280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:34.051135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040da463-f852-4dde-9297-c5b098403280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:34.052769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040da463-f852-4dde-9297-c5b098403280 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-040da463-f852-4dde-9297-c5b098403280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:34.068824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:34.069924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:34.070849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:34.070849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:34.070849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:34.070849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 526/1046] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:34.078550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040da463-f852-4dde-9297-c5b098403280 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:34.081806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:34.126128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:34.171316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a85801-ff39-4466-9682-34b2dd617a60 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:34.207635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040da463-f852-4dde-9297-c5b098403280 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:34.218104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fca08d-a474-40bb-a5b5-cf9fc11e185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:34.219106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fca08d-a474-40bb-a5b5-cf9fc11e185a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:34.219380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fca08d-a474-40bb-a5b5-cf9fc11e185a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:34.219956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fca08d-a474-40bb-a5b5-cf9fc11e185a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:34.249877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa2ae2-1032-40e0-aeaa-74f4556c0174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:34.250430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa2ae2-1032-40e0-aeaa-74f4556c0174 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:34.250710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa2ae2-1032-40e0-aeaa-74f4556c0174 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:34.250989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa2ae2-1032-40e0-aeaa-74f4556c0174 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:34.251633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa2ae2-1032-40e0-aeaa-74f4556c0174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:34.251940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa2ae2-1032-40e0-aeaa-74f4556c0174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:34.253343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa2ae2-1032-40e0-aeaa-74f4556c0174 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:34.266699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 527/1047] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:34.272290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa2ae2-1032-40e0-aeaa-74f4556c0174 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:34.307337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fca08d-a474-40bb-a5b5-cf9fc11e185a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:34.309083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fca08d-a474-40bb-a5b5-cf9fc11e185a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:34.353262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:34.386555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:34.407452 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa2ae2-1032-40e0-aeaa-74f4556c0174 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:34.425943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 521/1048] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:34 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:38:34.432920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fca08d-a474-40bb-a5b5-cf9fc11e185a None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:34.453212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4c96-2415-4597-8823-4b773ae81885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:34.453875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4c96-2415-4597-8823-4b773ae81885 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:34.454158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4c96-2415-4597-8823-4b773ae81885 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:34.454414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4c96-2415-4597-8823-4b773ae81885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:34.464188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a4c96-2415-4597-8823-4b773ae81885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:34.465882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a4c96-2415-4597-8823-4b773ae81885 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-f02a4c96-2415-4597-8823-4b773ae81885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:34.478590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:34.479645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:34.486015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:34.486015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:34.486015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:34.486015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:34.486015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:34.486015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:34.486015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:34.486015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:34.486015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 528/1049] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:34.489216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4c96-2415-4597-8823-4b773ae81885 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:34.591313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fca08d-a474-40bb-a5b5-cf9fc11e185a None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:34.629388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66694d3-e61b-4d27-b03a-08a7a57d72ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:34.630360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66694d3-e61b-4d27-b03a-08a7a57d72ed None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:34.630812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66694d3-e61b-4d27-b03a-08a7a57d72ed None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:34.631259 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66694d3-e61b-4d27-b03a-08a7a57d72ed None admin] PATH_INFO: `/v3/projects/efebc85e11db419a88763158037d01f1` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:34.632670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66694d3-e61b-4d27-b03a-08a7a57d72ed None admin] RBAC: Authorizing `identity:get_project(project_id=efebc85e11db419a88763158037d01f1)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:34.634299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66694d3-e61b-4d27-b03a-08a7a57d72ed None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:34.636125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 522/1050] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:38:34 2022] GET /identity/v3/projects/efebc85e11db419a88763158037d01f1 => generated 311 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:34.637026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4c96-2415-4597-8823-4b773ae81885 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:34.643389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66694d3-e61b-4d27-b03a-08a7a57d72ed None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:34.662904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:34.676474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f5442-59e7-41f6-a66e-b596758686ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:34.680949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f5442-59e7-41f6-a66e-b596758686ba None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:34.680949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f5442-59e7-41f6-a66e-b596758686ba None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:34.680949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f5442-59e7-41f6-a66e-b596758686ba None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:34.680949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f5442-59e7-41f6-a66e-b596758686ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:34.680949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f5442-59e7-41f6-a66e-b596758686ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:34.680949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f5442-59e7-41f6-a66e-b596758686ba None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:34.687849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:34.693851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 529/1051] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:34.700276 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f5442-59e7-41f6-a66e-b596758686ba None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:34.768167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66694d3-e61b-4d27-b03a-08a7a57d72ed None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:34.812166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c0efd-ced1-4337-802d-c5cbc2e2710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:34.813062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0efd-ced1-4337-802d-c5cbc2e2710a None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:34.813540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0efd-ced1-4337-802d-c5cbc2e2710a None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:34.813808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0efd-ced1-4337-802d-c5cbc2e2710a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:34.814697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c0efd-ced1-4337-802d-c5cbc2e2710a None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=efebc85e11db419a88763158037d01f1, user.id=1ed7ebdd20a544d39e2fb2cf86083da7) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:34.814834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c0efd-ced1-4337-802d-c5cbc2e2710a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:34.816319 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c0efd-ced1-4337-802d-c5cbc2e2710a None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:34.832546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 523/1052] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:34 2022] GET /identity/v3/role_assignments?user.id=1ed7ebdd20a544d39e2fb2cf86083da7&scope.project.id=efebc85e11db419a88763158037d01f1&role.id=eeb6551eeb934053866fc821b511b5dd => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:34.845432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f5442-59e7-41f6-a66e-b596758686ba None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:34.899204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2165f0b-8ff5-4b46-9b00-2b06a8e05ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:34.900039 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2165f0b-8ff5-4b46-9b00-2b06a8e05ba4 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:34.900541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2165f0b-8ff5-4b46-9b00-2b06a8e05ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:34.901018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2165f0b-8ff5-4b46-9b00-2b06a8e05ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:34.902409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2165f0b-8ff5-4b46-9b00-2b06a8e05ba4 None admin] RBAC: Adding query filter params (role.id=bd1525385a604a11ae4a956f07a384b9, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=1c12495a6cf64c80b45785f185f28383) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:34.902949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2165f0b-8ff5-4b46-9b00-2b06a8e05ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:34.906026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2165f0b-8ff5-4b46-9b00-2b06a8e05ba4 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:34.912567 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 530/1053] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:34 2022] GET /identity/v3/role_assignments?user.id=1c12495a6cf64c80b45785f185f28383&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=bd1525385a604a11ae4a956f07a384b9 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:35.310384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e8b94-f724-45bc-8cb3-69583c160b80 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:35.310737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e8b94-f724-45bc-8cb3-69583c160b80 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:35.310950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e8b94-f724-45bc-8cb3-69583c160b80 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:35.312506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 524/1054] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:35.318885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0c489-556e-44ad-bf97-e1148ea83f5a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:35.319251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0c489-556e-44ad-bf97-e1148ea83f5a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:35.319603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0c489-556e-44ad-bf97-e1148ea83f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:35.339065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d1b0c489-556e-44ad-bf97-e1148ea83f5a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:35.340273 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d1b0c489-556e-44ad-bf97-e1148ea83f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:35.388938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:35.414545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 531/1055] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:35.687534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e8b94-f724-45bc-8cb3-69583c160b80 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:35.814557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:35.819178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e8b94-f724-45bc-8cb3-69583c160b80 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:35.861777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c837a39-9521-449c-924b-f2a2be176aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:35.862683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c837a39-9521-449c-924b-f2a2be176aac None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:35.863107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c837a39-9521-449c-924b-f2a2be176aac None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:35.863509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c837a39-9521-449c-924b-f2a2be176aac None admin] PATH_INFO: `/v3/services/image` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:35.864245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c837a39-9521-449c-924b-f2a2be176aac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:35.865821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c837a39-9521-449c-924b-f2a2be176aac None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-1c837a39-9521-449c-924b-f2a2be176aac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:35.875631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:35.876896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:38:35.877865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:35.881507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 525/1056] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Aug 22 15:38:35 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:35.889705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0c489-556e-44ad-bf97-e1148ea83f5a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:36.040987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0c489-556e-44ad-bf97-e1148ea83f5a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:36.081815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ec8b6-e02d-4d66-a7c7-bbed410febc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:36.082434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec8b6-e02d-4d66-a7c7-bbed410febc0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:36.082711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec8b6-e02d-4d66-a7c7-bbed410febc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:36.082998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ec8b6-e02d-4d66-a7c7-bbed410febc0 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:36.083631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ec8b6-e02d-4d66-a7c7-bbed410febc0 None admin] RBAC: Adding query filter params (name=image) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:36.083956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ec8b6-e02d-4d66-a7c7-bbed410febc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:36.085738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ec8b6-e02d-4d66-a7c7-bbed410febc0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:36.093387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 532/1057] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:36.101620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c837a39-9521-449c-924b-f2a2be176aac None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:36.242627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c837a39-9521-449c-924b-f2a2be176aac None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:36.278109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ef478-6be7-4b42-9abc-1028f4f668dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:36.278720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ef478-6be7-4b42-9abc-1028f4f668dc None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:36.278994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ef478-6be7-4b42-9abc-1028f4f668dc None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:36.279263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ef478-6be7-4b42-9abc-1028f4f668dc None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:36.279885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ef478-6be7-4b42-9abc-1028f4f668dc None admin] RBAC: Adding query filter params (type=image) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:36.280188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ef478-6be7-4b42-9abc-1028f4f668dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:36.282989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ef478-6be7-4b42-9abc-1028f4f668dc None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:36.292004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 526/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:36.293595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ec8b6-e02d-4d66-a7c7-bbed410febc0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:36.340855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:36.437607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ec8b6-e02d-4d66-a7c7-bbed410febc0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:36.476501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf266f-b848-40c1-90e0-1abf622d808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:36.477148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf266f-b848-40c1-90e0-1abf622d808a None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:36.477429 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf266f-b848-40c1-90e0-1abf622d808a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:36.477699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf266f-b848-40c1-90e0-1abf622d808a None admin] PATH_INFO: `/v3/endpoints` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:36.478369 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf266f-b848-40c1-90e0-1abf622d808a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:36.479736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf266f-b848-40c1-90e0-1abf622d808a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:36.584334 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 533/1059] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:38:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:38:36.830788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375cb68-9586-4644-a5e4-8ced2efc0433 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:36.831523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375cb68-9586-4644-a5e4-8ced2efc0433 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:36.831523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375cb68-9586-4644-a5e4-8ced2efc0433 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:36.832834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 527/1060] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:36.838961 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a925e-2dc3-46aa-b906-fd1384533817 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:36.839181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a925e-2dc3-46aa-b906-fd1384533817 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:36.839451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a925e-2dc3-46aa-b906-fd1384533817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:36.858162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-cb6a925e-2dc3-46aa-b906-fd1384533817 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:36.859402 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-cb6a925e-2dc3-46aa-b906-fd1384533817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:36.906637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93c9af-ff1d-4cad-af62-62c6749becbd None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:36.907029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93c9af-ff1d-4cad-af62-62c6749becbd None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:36.907175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93c9af-ff1d-4cad-af62-62c6749becbd None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:36.908762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 528/1061] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:38:36.914407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ae76-7a93-4bec-acb8-caf096175bb5 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:36.914692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ae76-7a93-4bec-acb8-caf096175bb5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:36.914970 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ae76-7a93-4bec-acb8-caf096175bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:36.933549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-0f82ae76-7a93-4bec-acb8-caf096175bb5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:36.934753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0f82ae76-7a93-4bec-acb8-caf096175bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:36.957756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 534/1062] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:36.960502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:37.008654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 529/1063] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:37.229522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a925e-2dc3-46aa-b906-fd1384533817 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:37.253561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:37.277626 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82ae76-7a93-4bec-acb8-caf096175bb5 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:37.339510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a925e-2dc3-46aa-b906-fd1384533817 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:37.383701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6f8f3-7706-4341-8963-8396a9b91721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:37.384625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f8f3-7706-4341-8963-8396a9b91721 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:37.384625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f8f3-7706-4341-8963-8396a9b91721 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:37.384912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6f8f3-7706-4341-8963-8396a9b91721 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:37.388491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82ae76-7a93-4bec-acb8-caf096175bb5 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:37.397566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a6f8f3-7706-4341-8963-8396a9b91721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-b5a6f8f3-7706-4341-8963-8396a9b91721 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:37.402153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:37.403149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:37.404015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 535/1064] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:38:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:37.409632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6f8f3-7706-4341-8963-8396a9b91721 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:37.429816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177a350-9ab6-4fb5-9c75-ae7a9b09d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:37.430456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177a350-9ab6-4fb5-9c75-ae7a9b09d6f3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:37.430823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177a350-9ab6-4fb5-9c75-ae7a9b09d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:37.431018 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177a350-9ab6-4fb5-9c75-ae7a9b09d6f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:37.442689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177a350-9ab6-4fb5-9c75-ae7a9b09d6f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-e177a350-9ab6-4fb5-9c75-ae7a9b09d6f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:37.448393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:37.450048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:37.450938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 530/1065] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 15:38:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:37.455630 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177a350-9ab6-4fb5-9c75-ae7a9b09d6f3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:37.479744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:37.514161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:37.533372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6f8f3-7706-4341-8963-8396a9b91721 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:37.574900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88667274-4e95-4351-a524-0bb61596643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:37.575652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88667274-4e95-4351-a524-0bb61596643a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:37.576036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88667274-4e95-4351-a524-0bb61596643a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:37.576410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88667274-4e95-4351-a524-0bb61596643a None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:37.577222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88667274-4e95-4351-a524-0bb61596643a None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:37.577530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88667274-4e95-4351-a524-0bb61596643a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:37.578697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177a350-9ab6-4fb5-9c75-ae7a9b09d6f3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:37.578919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88667274-4e95-4351-a524-0bb61596643a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:37.589922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 536/1066] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:37.595957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88667274-4e95-4351-a524-0bb61596643a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:37.621800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d46274-fe74-498c-8b15-f49ccbd73951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:37.622866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d46274-fe74-498c-8b15-f49ccbd73951 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:37.623147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d46274-fe74-498c-8b15-f49ccbd73951 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:37.623571 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d46274-fe74-498c-8b15-f49ccbd73951 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:37.624241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d46274-fe74-498c-8b15-f49ccbd73951 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:37.624642 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d46274-fe74-498c-8b15-f49ccbd73951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:37.625977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d46274-fe74-498c-8b15-f49ccbd73951 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:37.640417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 531/1067] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 15:38:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:37.641739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d46274-fe74-498c-8b15-f49ccbd73951 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:37.716632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88667274-4e95-4351-a524-0bb61596643a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:37.732842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:37.752838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d46274-fe74-498c-8b15-f49ccbd73951 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:37.757494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddebff-ca2c-4969-826c-9b976829e1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:37.758369 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddebff-ca2c-4969-826c-9b976829e1f0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:37.758750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddebff-ca2c-4969-826c-9b976829e1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:37.759122 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddebff-ca2c-4969-826c-9b976829e1f0 None admin] PATH_INFO: `/v3/users/1ed7ebdd20a544d39e2fb2cf86083da7` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:37.760454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddebff-ca2c-4969-826c-9b976829e1f0 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed7ebdd20a544d39e2fb2cf86083da7)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:37.761919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddebff-ca2c-4969-826c-9b976829e1f0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:37.763717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 537/1068] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:38:37 2022] GET /identity/v3/users/1ed7ebdd20a544d39e2fb2cf86083da7 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:37.769280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddebff-ca2c-4969-826c-9b976829e1f0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:37.786310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:37.791296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268c8aa-444f-4f7a-8444-73c68ebafdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:37.791927 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c8aa-444f-4f7a-8444-73c68ebafdd4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:37.792199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c8aa-444f-4f7a-8444-73c68ebafdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:37.792538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c8aa-444f-4f7a-8444-73c68ebafdd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:37.805545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268c8aa-444f-4f7a-8444-73c68ebafdd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:37.807021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268c8aa-444f-4f7a-8444-73c68ebafdd4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-a268c8aa-444f-4f7a-8444-73c68ebafdd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:37.822912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:37.823951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:37.824893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:37.824893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:37.824893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:37.824893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 532/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:37.832110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268c8aa-444f-4f7a-8444-73c68ebafdd4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:37.897008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddebff-ca2c-4969-826c-9b976829e1f0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:37.943696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88472612-9287-4c14-9d89-050bf60075a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:37.944339 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88472612-9287-4c14-9d89-050bf60075a5 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:37.944643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88472612-9287-4c14-9d89-050bf60075a5 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:37.944914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88472612-9287-4c14-9d89-050bf60075a5 None admin] PATH_INFO: `/v3/projects/efebc85e11db419a88763158037d01f1` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:37.946048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88472612-9287-4c14-9d89-050bf60075a5 None admin] RBAC: Authorizing `identity:get_project(project_id=efebc85e11db419a88763158037d01f1)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:37.947522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88472612-9287-4c14-9d89-050bf60075a5 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:37.949469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 538/1070] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:38:37 2022] GET /identity/v3/projects/efebc85e11db419a88763158037d01f1 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:37.954321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268c8aa-444f-4f7a-8444-73c68ebafdd4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:37.955211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88472612-9287-4c14-9d89-050bf60075a5 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:37.993534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:37.999077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1b77-bdef-4cd2-8e54-e30128109023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:37.999725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1b77-bdef-4cd2-8e54-e30128109023 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:37.999993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1b77-bdef-4cd2-8e54-e30128109023 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:38.000446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1b77-bdef-4cd2-8e54-e30128109023 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:38.000972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1b77-bdef-4cd2-8e54-e30128109023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:38.004724 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1b77-bdef-4cd2-8e54-e30128109023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:38.004724 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1b77-bdef-4cd2-8e54-e30128109023 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:38.016426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 533/1071] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:38.022134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1b77-bdef-4cd2-8e54-e30128109023 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:38.054863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:38.075136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88472612-9287-4c14-9d89-050bf60075a5 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:38.116064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eba30-2cc8-408b-9f98-4f7dacb21942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:38.116783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eba30-2cc8-408b-9f98-4f7dacb21942 None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:38.117058 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eba30-2cc8-408b-9f98-4f7dacb21942 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:38.117399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26eba30-2cc8-408b-9f98-4f7dacb21942 None admin] PATH_INFO: `/v3/projects/efebc85e11db419a88763158037d01f1/users/1ed7ebdd20a544d39e2fb2cf86083da7/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:38.119558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26eba30-2cc8-408b-9f98-4f7dacb21942 None admin] RBAC: Authorizing `identity:create_grant(project_id=efebc85e11db419a88763158037d01f1, user_id=1ed7ebdd20a544d39e2fb2cf86083da7, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:38.121056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26eba30-2cc8-408b-9f98-4f7dacb21942 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:38.146264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1b77-bdef-4cd2-8e54-e30128109023 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:38.187144 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a488e87-256f-4f3a-a267-d4be85be6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:38.187828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a488e87-256f-4f3a-a267-d4be85be6936 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:38.188276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a488e87-256f-4f3a-a267-d4be85be6936 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:38.188655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a488e87-256f-4f3a-a267-d4be85be6936 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:38.196150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a488e87-256f-4f3a-a267-d4be85be6936 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:38.197629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a488e87-256f-4f3a-a267-d4be85be6936 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-2a488e87-256f-4f3a-a267-d4be85be6936 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:38.214382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:38.216550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:38.217567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 534/1072] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 15:38:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:38.224026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a488e87-256f-4f3a-a267-d4be85be6936 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:38.240857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 539/1073] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:38:37 2022] PUT /identity/v3/projects/efebc85e11db419a88763158037d01f1/users/1ed7ebdd20a544d39e2fb2cf86083da7/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:38:38.301179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:38.364527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a488e87-256f-4f3a-a267-d4be85be6936 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:38.410815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd7453-f3e2-4552-81ee-8b49194e2353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:38.411493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd7453-f3e2-4552-81ee-8b49194e2353 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:38.411799 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd7453-f3e2-4552-81ee-8b49194e2353 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:38.412067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd7453-f3e2-4552-81ee-8b49194e2353 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:38.412876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd7453-f3e2-4552-81ee-8b49194e2353 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:38.413180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd7453-f3e2-4552-81ee-8b49194e2353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:38.414645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd7453-f3e2-4552-81ee-8b49194e2353 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:38.436446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 535/1074] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 15:38:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:38.444054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eba30-2cc8-408b-9f98-4f7dacb21942 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:38.557941 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26eba30-2cc8-408b-9f98-4f7dacb21942 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:38.604300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf1d7-4e02-4f43-908f-9cfcec34355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:38.605089 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf1d7-4e02-4f43-908f-9cfcec34355d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:38.605419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf1d7-4e02-4f43-908f-9cfcec34355d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:38.605729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf1d7-4e02-4f43-908f-9cfcec34355d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:38.615533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:38.618692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf1d7-4e02-4f43-908f-9cfcec34355d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:38.620166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf1d7-4e02-4f43-908f-9cfcec34355d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-bbcaf1d7-4e02-4f43-908f-9cfcec34355d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:38.638688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:38.639753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:38.641221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:38.641221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:38.641221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:38.644589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 540/1075] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:38.645954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd7453-f3e2-4552-81ee-8b49194e2353 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:38.779743 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd7453-f3e2-4552-81ee-8b49194e2353 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:38.792291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:38.819248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7ef89-e2e8-4467-a493-687c54858e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:38.819738 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ef89-e2e8-4467-a493-687c54858e6f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:38.820016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ef89-e2e8-4467-a493-687c54858e6f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:38.820284 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ef89-e2e8-4467-a493-687c54858e6f None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:38.821285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7ef89-e2e8-4467-a493-687c54858e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:38.821593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7ef89-e2e8-4467-a493-687c54858e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:38.822978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7ef89-e2e8-4467-a493-687c54858e6f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:38.840980 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 536/1076] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:38.843281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf1d7-4e02-4f43-908f-9cfcec34355d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:38.922249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2fa31-5c44-4563-abc8-74769ee7f12f None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:38.922557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2fa31-5c44-4563-abc8-74769ee7f12f None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:38.922812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2fa31-5c44-4563-abc8-74769ee7f12f None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:38.924819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 537/1077] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:38:38.931170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999fee5-0711-47ae-993c-b1a66fcf9453 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:38.931461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999fee5-0711-47ae-993c-b1a66fcf9453 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:38.931739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999fee5-0711-47ae-993c-b1a66fcf9453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:38.952183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-0999fee5-0711-47ae-993c-b1a66fcf9453 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:38.953491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0999fee5-0711-47ae-993c-b1a66fcf9453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:38.976318 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf1d7-4e02-4f43-908f-9cfcec34355d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:39.028403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111a7ef-a995-445a-82ac-bc98c2c32f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:39.029203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111a7ef-a995-445a-82ac-bc98c2c32f3a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:39.029484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111a7ef-a995-445a-82ac-bc98c2c32f3a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:39.029761 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111a7ef-a995-445a-82ac-bc98c2c32f3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:39.031800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 538/1078] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:39.037572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111a7ef-a995-445a-82ac-bc98c2c32f3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:39.039105 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111a7ef-a995-445a-82ac-bc98c2c32f3a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-6111a7ef-a995-445a-82ac-bc98c2c32f3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:39.051864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:39.056808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:39.058225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:39.058225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:39.058225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:39.058225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:39.058225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:39.058225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:39.058225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:39.058225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:39.058225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 541/1079] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:39.060616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999fee5-0711-47ae-993c-b1a66fcf9453 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:39.178914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:39.182775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999fee5-0711-47ae-993c-b1a66fcf9453 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:39.220925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdeb596-6046-465b-ac4b-b8083f10b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:39.221571 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdeb596-6046-465b-ac4b-b8083f10b095 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:39.221830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdeb596-6046-465b-ac4b-b8083f10b095 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:39.222099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdeb596-6046-465b-ac4b-b8083f10b095 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:39.222800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdeb596-6046-465b-ac4b-b8083f10b095 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:39.223106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdeb596-6046-465b-ac4b-b8083f10b095 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:39.224581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdeb596-6046-465b-ac4b-b8083f10b095 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:39.237876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 539/1080] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:39.244792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111a7ef-a995-445a-82ac-bc98c2c32f3a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:39.310446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdeb596-6046-465b-ac4b-b8083f10b095 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:39.311622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:39.378214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111a7ef-a995-445a-82ac-bc98c2c32f3a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:39.436295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67930f-fbb7-437c-a036-832b0f8aecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:39.436911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67930f-fbb7-437c-a036-832b0f8aecdf None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:39.437190 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67930f-fbb7-437c-a036-832b0f8aecdf None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:39.437466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67930f-fbb7-437c-a036-832b0f8aecdf None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/1c12495a6cf64c80b45785f185f28383/roles/bd1525385a604a11ae4a956f07a384b9` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:39.440084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67930f-fbb7-437c-a036-832b0f8aecdf None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=1c12495a6cf64c80b45785f185f28383, role_id=bd1525385a604a11ae4a956f07a384b9)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:39.442207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67930f-fbb7-437c-a036-832b0f8aecdf None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:39.446300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdeb596-6046-465b-ac4b-b8083f10b095 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:39.483472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba416c7-ba49-4ffc-9094-3bfac6697675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:39.484261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba416c7-ba49-4ffc-9094-3bfac6697675 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:39.484572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba416c7-ba49-4ffc-9094-3bfac6697675 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:39.484844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba416c7-ba49-4ffc-9094-3bfac6697675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:39.515995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 542/1081] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:38:39 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/1c12495a6cf64c80b45785f185f28383/roles/bd1525385a604a11ae4a956f07a384b9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:38:39.520464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:39.570059 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba416c7-ba49-4ffc-9094-3bfac6697675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:39.571906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba416c7-ba49-4ffc-9094-3bfac6697675 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:39.722625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 540/1082] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:38:39.728875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67930f-fbb7-437c-a036-832b0f8aecdf None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:39.855475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67930f-fbb7-437c-a036-832b0f8aecdf None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:39.870001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:39.893806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62bdd-0f70-4207-aa3b-6ef0a9cd64f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:39.894462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62bdd-0f70-4207-aa3b-6ef0a9cd64f0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:39.894743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62bdd-0f70-4207-aa3b-6ef0a9cd64f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:39.895017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62bdd-0f70-4207-aa3b-6ef0a9cd64f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:39.909456 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62bdd-0f70-4207-aa3b-6ef0a9cd64f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:39.912935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62bdd-0f70-4207-aa3b-6ef0a9cd64f0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-e0a62bdd-0f70-4207-aa3b-6ef0a9cd64f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:39.938203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:39.939445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:39.941000 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:39.941000 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:39.941000 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:39.942139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 543/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:38:39.946644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba416c7-ba49-4ffc-9094-3bfac6697675 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:40.017076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:40.061151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba416c7-ba49-4ffc-9094-3bfac6697675 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:40.104299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf2462-0858-416b-afa7-2124f41ee850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:40.104937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf2462-0858-416b-afa7-2124f41ee850 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:40.105215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf2462-0858-416b-afa7-2124f41ee850 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:40.105483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf2462-0858-416b-afa7-2124f41ee850 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:40.106142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf2462-0858-416b-afa7-2124f41ee850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:40.106442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf2462-0858-416b-afa7-2124f41ee850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:40.107800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf2462-0858-416b-afa7-2124f41ee850 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:40.121190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 541/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:40.221225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b764-30c9-4845-b2c2-cb44fe324696 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:40.221767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b764-30c9-4845-b2c2-cb44fe324696 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:40.221767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b764-30c9-4845-b2c2-cb44fe324696 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:40.223339 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 544/1085] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:40.229802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737673-f683-4b41-baaf-667e6b6eb0b7 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:40.230142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737673-f683-4b41-baaf-667e6b6eb0b7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:40.230357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a737673-f683-4b41-baaf-667e6b6eb0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:40.251696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8a737673-f683-4b41-baaf-667e6b6eb0b7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:40.252979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8a737673-f683-4b41-baaf-667e6b6eb0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:40.339855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 542/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:40.617457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b764-30c9-4845-b2c2-cb44fe324696 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:40.739198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b764-30c9-4845-b2c2-cb44fe324696 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:40.777791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e23de-69b9-49ea-8aab-53133f54d1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:40.778467 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e23de-69b9-49ea-8aab-53133f54d1c6 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:40.778748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e23de-69b9-49ea-8aab-53133f54d1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:40.779021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e23de-69b9-49ea-8aab-53133f54d1c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:40.791638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e23de-69b9-49ea-8aab-53133f54d1c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-599e23de-69b9-49ea-8aab-53133f54d1c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:40.796578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:40.797620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:40.798535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 545/1087] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:38:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:40.804611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a737673-f683-4b41-baaf-667e6b6eb0b7 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:40.864806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:40.929036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a737673-f683-4b41-baaf-667e6b6eb0b7 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:40.968350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3e015-ed5c-4d63-8efb-13b11a9856da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:40.969006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3e015-ed5c-4d63-8efb-13b11a9856da None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:40.969283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3e015-ed5c-4d63-8efb-13b11a9856da None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:40.969578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3e015-ed5c-4d63-8efb-13b11a9856da None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:40.970269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3e015-ed5c-4d63-8efb-13b11a9856da None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:40.970552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3e015-ed5c-4d63-8efb-13b11a9856da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:40.971925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3e015-ed5c-4d63-8efb-13b11a9856da None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:40.981092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 543/1088] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:38:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:40.987575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e23de-69b9-49ea-8aab-53133f54d1c6 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:41.026280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:41.111002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e23de-69b9-49ea-8aab-53133f54d1c6 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:41.151303 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15694a5a-81dd-4ec4-b91a-207ca0c85d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:41.152830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15694a5a-81dd-4ec4-b91a-207ca0c85d74 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:41.152830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15694a5a-81dd-4ec4-b91a-207ca0c85d74 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:41.152830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15694a5a-81dd-4ec4-b91a-207ca0c85d74 None admin] PATH_INFO: `/v3/users/1ed7ebdd20a544d39e2fb2cf86083da7` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:41.153795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15694a5a-81dd-4ec4-b91a-207ca0c85d74 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed7ebdd20a544d39e2fb2cf86083da7)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:41.155243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15694a5a-81dd-4ec4-b91a-207ca0c85d74 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:41.156884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 546/1089] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:38:40 2022] GET /identity/v3/users/1ed7ebdd20a544d39e2fb2cf86083da7 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:41.162999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3e015-ed5c-4d63-8efb-13b11a9856da None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:41.276716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3e015-ed5c-4d63-8efb-13b11a9856da None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:41.290660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:41.315978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194dae8-19ed-4ead-ac35-42793aca342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:41.316739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194dae8-19ed-4ead-ac35-42793aca342f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:41.317072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194dae8-19ed-4ead-ac35-42793aca342f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:41.317445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194dae8-19ed-4ead-ac35-42793aca342f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:41.393881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194dae8-19ed-4ead-ac35-42793aca342f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:41.395342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194dae8-19ed-4ead-ac35-42793aca342f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:41.498716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99891b-7b44-4a66-baec-9477bac62b92 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:41.499261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99891b-7b44-4a66-baec-9477bac62b92 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:41.499261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99891b-7b44-4a66-baec-9477bac62b92 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:41.499741 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 544/1090] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:38:41.500680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 547/1091] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:38:41.506857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99891b-7b44-4a66-baec-9477bac62b92 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:41.507082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07b516-5b8e-4eb8-b017-6d9cb9bcc9bd None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:41.507183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07b516-5b8e-4eb8-b017-6d9cb9bcc9bd None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:41.507423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07b516-5b8e-4eb8-b017-6d9cb9bcc9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:41.526504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ea07b516-5b8e-4eb8-b017-6d9cb9bcc9bd None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:41.527911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ea07b516-5b8e-4eb8-b017-6d9cb9bcc9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:41.537175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:41.608819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:41.610898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 545/1092] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:41.620954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99891b-7b44-4a66-baec-9477bac62b92 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:41.655761 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1c7b7-62be-4423-8bbf-15475aa6a2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:41.656410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1c7b7-62be-4423-8bbf-15475aa6a2d2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:41.656709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1c7b7-62be-4423-8bbf-15475aa6a2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:41.656981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1c7b7-62be-4423-8bbf-15475aa6a2d2 None admin] PATH_INFO: `/v3/projects/efebc85e11db419a88763158037d01f1` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:41.658090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1c7b7-62be-4423-8bbf-15475aa6a2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=efebc85e11db419a88763158037d01f1)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:41.659521 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1c7b7-62be-4423-8bbf-15475aa6a2d2 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:41.661413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 548/1093] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:38:41 2022] GET /identity/v3/projects/efebc85e11db419a88763158037d01f1 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:41.668023 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07b516-5b8e-4eb8-b017-6d9cb9bcc9bd None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:41.770777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07b516-5b8e-4eb8-b017-6d9cb9bcc9bd None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:41.806180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5d68c-1ce6-4f23-857a-01f7d755137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:41.806703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5d68c-1ce6-4f23-857a-01f7d755137c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:41.806980 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5d68c-1ce6-4f23-857a-01f7d755137c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:41.807251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5d68c-1ce6-4f23-857a-01f7d755137c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:41.807977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5d68c-1ce6-4f23-857a-01f7d755137c None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=efebc85e11db419a88763158037d01f1, user.id=1ed7ebdd20a544d39e2fb2cf86083da7) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:41.808285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5d68c-1ce6-4f23-857a-01f7d755137c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:41.809785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5d68c-1ce6-4f23-857a-01f7d755137c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:41.816016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 546/1094] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:41 2022] GET /identity/v3/role_assignments?user.id=1ed7ebdd20a544d39e2fb2cf86083da7&scope.project.id=efebc85e11db419a88763158037d01f1&role.id=eeb6551eeb934053866fc821b511b5dd => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:41.884507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1c7b7-62be-4423-8bbf-15475aa6a2d2 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:41.998122 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1c7b7-62be-4423-8bbf-15475aa6a2d2 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:42.034245 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417da7ad-9376-4532-8d36-f0c021f45f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:42.034887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417da7ad-9376-4532-8d36-f0c021f45f99 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:42.035159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417da7ad-9376-4532-8d36-f0c021f45f99 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:42.035423 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417da7ad-9376-4532-8d36-f0c021f45f99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:42.045528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417da7ad-9376-4532-8d36-f0c021f45f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-417da7ad-9376-4532-8d36-f0c021f45f99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:38:42.050484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:42.051441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:42.053035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 549/1095] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 15:38:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:42.058341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5d68c-1ce6-4f23-857a-01f7d755137c None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:42.067129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:42.159372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5d68c-1ce6-4f23-857a-01f7d755137c None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:42.198253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cffa17-2970-4846-821d-fceb467bec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:42.198940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cffa17-2970-4846-821d-fceb467bec6f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:42.199256 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cffa17-2970-4846-821d-fceb467bec6f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:42.199573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cffa17-2970-4846-821d-fceb467bec6f None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:42.200361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cffa17-2970-4846-821d-fceb467bec6f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:42.200800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cffa17-2970-4846-821d-fceb467bec6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:42.202164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cffa17-2970-4846-821d-fceb467bec6f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:42.210756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 547/1096] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 15:38:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:42.216421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417da7ad-9376-4532-8d36-f0c021f45f99 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:42.238770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:42.321861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417da7ad-9376-4532-8d36-f0c021f45f99 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:42.356271 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cc417-d4ad-4a24-84f2-8fc40a992219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:42.357035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cc417-d4ad-4a24-84f2-8fc40a992219 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:42.357322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cc417-d4ad-4a24-84f2-8fc40a992219 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:42.357599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cc417-d4ad-4a24-84f2-8fc40a992219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:42.368854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cc417-d4ad-4a24-84f2-8fc40a992219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:42.370343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cc417-d4ad-4a24-84f2-8fc40a992219 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-050cc417-d4ad-4a24-84f2-8fc40a992219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:42.385314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:42.386379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:42.387433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:42.387433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:42.387433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:42.387433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 550/1097] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:42.392749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cffa17-2970-4846-821d-fceb467bec6f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:42.461097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:42.495615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cffa17-2970-4846-821d-fceb467bec6f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:42.530212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311807fc-d0f2-4e94-b0f7-cc49c6f8bb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:42.530818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311807fc-d0f2-4e94-b0f7-cc49c6f8bb33 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:42.531094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311807fc-d0f2-4e94-b0f7-cc49c6f8bb33 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:42.531365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311807fc-d0f2-4e94-b0f7-cc49c6f8bb33 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:42.532072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311807fc-d0f2-4e94-b0f7-cc49c6f8bb33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:42.532379 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311807fc-d0f2-4e94-b0f7-cc49c6f8bb33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:42.533778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311807fc-d0f2-4e94-b0f7-cc49c6f8bb33 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:42.546475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 548/1098] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:42.552580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cc417-d4ad-4a24-84f2-8fc40a992219 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:42.628182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:42.660152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cc417-d4ad-4a24-84f2-8fc40a992219 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:42.695151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151aedf-6720-4adf-9c5a-e366c30acbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:42.695781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151aedf-6720-4adf-9c5a-e366c30acbbc None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:42.696052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151aedf-6720-4adf-9c5a-e366c30acbbc None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:42.696320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151aedf-6720-4adf-9c5a-e366c30acbbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:42.704913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151aedf-6720-4adf-9c5a-e366c30acbbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:42.706349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151aedf-6720-4adf-9c5a-e366c30acbbc None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-a151aedf-6720-4adf-9c5a-e366c30acbbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:38:42.717511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:42.718629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:38:42.719625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 551/1099] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 15:38:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:42.725182 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311807fc-d0f2-4e94-b0f7-cc49c6f8bb33 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:42.829170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311807fc-d0f2-4e94-b0f7-cc49c6f8bb33 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:42.857942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:42.866048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1563d-b74f-4378-8c3f-35255c56def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:42.866703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1563d-b74f-4378-8c3f-35255c56def5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:42.866982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1563d-b74f-4378-8c3f-35255c56def5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:42.867255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1563d-b74f-4378-8c3f-35255c56def5 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:42.867987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1563d-b74f-4378-8c3f-35255c56def5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:42.877906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1563d-b74f-4378-8c3f-35255c56def5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:42.877906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1563d-b74f-4378-8c3f-35255c56def5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:42.888776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 549/1100] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 15:38:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:42.894573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151aedf-6720-4adf-9c5a-e366c30acbbc None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:43.013075 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151aedf-6720-4adf-9c5a-e366c30acbbc None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:43.043563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:43.049015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d220a2d-d0d4-4f35-8ccf-37f5da9f3ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:43.049625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d220a2d-d0d4-4f35-8ccf-37f5da9f3ae6 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:43.049900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d220a2d-d0d4-4f35-8ccf-37f5da9f3ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:43.050164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d220a2d-d0d4-4f35-8ccf-37f5da9f3ae6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:43.117736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d220a2d-d0d4-4f35-8ccf-37f5da9f3ae6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:43.119205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d220a2d-d0d4-4f35-8ccf-37f5da9f3ae6 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:43.220666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 552/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:38:43.227692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1563d-b74f-4378-8c3f-35255c56def5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:43.342272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1563d-b74f-4378-8c3f-35255c56def5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:43.382076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2c59f-b320-491f-b547-dd264d38c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:43.382720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2c59f-b320-491f-b547-dd264d38c659 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:43.383003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2c59f-b320-491f-b547-dd264d38c659 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:43.383275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2c59f-b320-491f-b547-dd264d38c659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:43.395014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2c59f-b320-491f-b547-dd264d38c659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:43.396504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2c59f-b320-491f-b547-dd264d38c659 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-3ee2c59f-b320-491f-b547-dd264d38c659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:38:43.414945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:43.415993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:38:43.416939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:38:43.416939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:38:43.416939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:43.416939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 550/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:43.422189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d220a2d-d0d4-4f35-8ccf-37f5da9f3ae6 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:43.458861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:43.538262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d220a2d-d0d4-4f35-8ccf-37f5da9f3ae6 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:43.576593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fc4da-49c6-4180-8dab-f9529667f93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:43.577589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fc4da-49c6-4180-8dab-f9529667f93a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:43.577964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fc4da-49c6-4180-8dab-f9529667f93a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:43.578325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fc4da-49c6-4180-8dab-f9529667f93a None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:43.579082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fc4da-49c6-4180-8dab-f9529667f93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:43.579476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fc4da-49c6-4180-8dab-f9529667f93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:43.581059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fc4da-49c6-4180-8dab-f9529667f93a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:43.594498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 553/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:43.601221 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2c59f-b320-491f-b547-dd264d38c659 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:43.655017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:43.725541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2c59f-b320-491f-b547-dd264d38c659 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:43.777341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46166af5-2eeb-40af-ac91-8b8b7a0c98d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:43.778108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46166af5-2eeb-40af-ac91-8b8b7a0c98d9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:43.778433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46166af5-2eeb-40af-ac91-8b8b7a0c98d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:43.778748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46166af5-2eeb-40af-ac91-8b8b7a0c98d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:43.788892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46166af5-2eeb-40af-ac91-8b8b7a0c98d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:43.791446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46166af5-2eeb-40af-ac91-8b8b7a0c98d9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-46166af5-2eeb-40af-ac91-8b8b7a0c98d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:38:43.805737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:38:43.807582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:38:43.809735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:38:43.809735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:38:43.809735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:38:43.809735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:38:43.809735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:38:43.809735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:38:43.809735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:38:43.809735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:38:43.811850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 551/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:38:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:38:43.813347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fc4da-49c6-4180-8dab-f9529667f93a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:43.817413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649cb0b-96a7-405b-a55d-8e60f0d7efd2 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:43.817728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649cb0b-96a7-405b-a55d-8e60f0d7efd2 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:43.818028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649cb0b-96a7-405b-a55d-8e60f0d7efd2 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:43.819386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 552/1105] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:38:43.825922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a95a7-0b18-45bf-a5c2-84f397835496 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:43.826324 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a95a7-0b18-45bf-a5c2-84f397835496 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:43.826696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a95a7-0b18-45bf-a5c2-84f397835496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:43.851443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-181a95a7-0b18-45bf-a5c2-84f397835496 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:43.852706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-181a95a7-0b18-45bf-a5c2-84f397835496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:43.923077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:43.930819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 553/1106] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:43.939674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fc4da-49c6-4180-8dab-f9529667f93a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:43.978703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314e7af-6b1f-4d5f-bbdf-d97c3c055409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:43.982317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314e7af-6b1f-4d5f-bbdf-d97c3c055409 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:43.982317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314e7af-6b1f-4d5f-bbdf-d97c3c055409 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:43.982317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314e7af-6b1f-4d5f-bbdf-d97c3c055409 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:43.982317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314e7af-6b1f-4d5f-bbdf-d97c3c055409 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:43.982317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314e7af-6b1f-4d5f-bbdf-d97c3c055409 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:43.982730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314e7af-6b1f-4d5f-bbdf-d97c3c055409 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:43.996804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 554/1107] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:38:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:44.003172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a95a7-0b18-45bf-a5c2-84f397835496 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:44.034394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:44.119937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a95a7-0b18-45bf-a5c2-84f397835496 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:44.157547 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ae9d0-506d-4f1c-8328-af3bc5143cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:44.158217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ae9d0-506d-4f1c-8328-af3bc5143cb3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:44.158496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ae9d0-506d-4f1c-8328-af3bc5143cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:44.158768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ae9d0-506d-4f1c-8328-af3bc5143cb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:44.159511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ae9d0-506d-4f1c-8328-af3bc5143cb3 None admin] RBAC: Adding query filter params (role.id=bd1525385a604a11ae4a956f07a384b9, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=1c12495a6cf64c80b45785f185f28383) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:44.159968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ae9d0-506d-4f1c-8328-af3bc5143cb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:44.161941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ae9d0-506d-4f1c-8328-af3bc5143cb3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:44.168911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 554/1108] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:44 2022] GET /identity/v3/role_assignments?user.id=1c12495a6cf64c80b45785f185f28383&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=bd1525385a604a11ae4a956f07a384b9 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:44.219956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314e7af-6b1f-4d5f-bbdf-d97c3c055409 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:44.345756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314e7af-6b1f-4d5f-bbdf-d97c3c055409 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:44.394648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72ce07-101c-495d-bc0c-9a43215453ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:44.395301 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ce07-101c-495d-bc0c-9a43215453ab None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:44.396451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ce07-101c-495d-bc0c-9a43215453ab None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:44.396451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ce07-101c-495d-bc0c-9a43215453ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:44.397944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72ce07-101c-495d-bc0c-9a43215453ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:44.399927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72ce07-101c-495d-bc0c-9a43215453ab None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:44.401768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 555/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:44.407691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ae9d0-506d-4f1c-8328-af3bc5143cb3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:44.525567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:44.538370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ae9d0-506d-4f1c-8328-af3bc5143cb3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:44.579335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c240a36-e56c-4168-9171-33e9f23aea04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:44.579961 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240a36-e56c-4168-9171-33e9f23aea04 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:44.580243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240a36-e56c-4168-9171-33e9f23aea04 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:44.580612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240a36-e56c-4168-9171-33e9f23aea04 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:44.581261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c240a36-e56c-4168-9171-33e9f23aea04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:44.583839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c240a36-e56c-4168-9171-33e9f23aea04 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:44.698926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 555/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:38:44 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:38:46.725164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f96ba-b7df-46ae-a6b4-c93134b0da3c None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:46.725723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f96ba-b7df-46ae-a6b4-c93134b0da3c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:46.725723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f96ba-b7df-46ae-a6b4-c93134b0da3c None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:46.727086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 556/1111] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:46.733199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbb7c8-425f-4965-b91c-3e3caf5cfb5d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:46.733768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbb7c8-425f-4965-b91c-3e3caf5cfb5d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:46.733768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbb7c8-425f-4965-b91c-3e3caf5cfb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:46.755774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-bcfbb7c8-425f-4965-b91c-3e3caf5cfb5d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:46.761729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bcfbb7c8-425f-4965-b91c-3e3caf5cfb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:46.835040 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 556/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:47.113578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f96ba-b7df-46ae-a6b4-c93134b0da3c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:47.136956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:47.222418 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f96ba-b7df-46ae-a6b4-c93134b0da3c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:47.258713 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0ced7-0b7e-41e0-aec2-dde475ee7dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:47.259417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0ced7-0b7e-41e0-aec2-dde475ee7dcf None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:47.259697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0ced7-0b7e-41e0-aec2-dde475ee7dcf None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:47.259970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0ced7-0b7e-41e0-aec2-dde475ee7dcf None admin] PATH_INFO: `/v3/roles/e5562064df7e4f1a96a35d581b4f28c4` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:47.261450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0ced7-0b7e-41e0-aec2-dde475ee7dcf None admin] RBAC: Authorizing `identity:get_role(role_id=e5562064df7e4f1a96a35d581b4f28c4)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:47.262839 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0ced7-0b7e-41e0-aec2-dde475ee7dcf None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:47.264211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 557/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:38:47 2022] GET /identity/v3/roles/e5562064df7e4f1a96a35d581b4f28c4 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:47.271349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbb7c8-425f-4965-b91c-3e3caf5cfb5d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:47.367315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:47.388687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbb7c8-425f-4965-b91c-3e3caf5cfb5d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:47.425150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524f64-708d-422b-8f15-c5bfa8da5a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:47.425786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524f64-708d-422b-8f15-c5bfa8da5a83 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:47.426065 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524f64-708d-422b-8f15-c5bfa8da5a83 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:47.426415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524f64-708d-422b-8f15-c5bfa8da5a83 None admin] PATH_INFO: `/v3/users/fe777272a27c4886a2ea6c8d1a56c021` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:47.439977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524f64-708d-422b-8f15-c5bfa8da5a83 None admin] RBAC: Authorizing `identity:get_user(user_id=fe777272a27c4886a2ea6c8d1a56c021)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:47.441458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524f64-708d-422b-8f15-c5bfa8da5a83 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:47.443141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 557/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:38:47 2022] GET /identity/v3/users/fe777272a27c4886a2ea6c8d1a56c021 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:47.449109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0ced7-0b7e-41e0-aec2-dde475ee7dcf None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:47.543340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:47.556689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0ced7-0b7e-41e0-aec2-dde475ee7dcf None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:47.591547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c9a1d-75f9-4c76-b106-b6eacecf6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:47.592163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9a1d-75f9-4c76-b106-b6eacecf6823 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:47.592441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9a1d-75f9-4c76-b106-b6eacecf6823 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:47.592743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9a1d-75f9-4c76-b106-b6eacecf6823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:47.662626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c9a1d-75f9-4c76-b106-b6eacecf6823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:47.663995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c9a1d-75f9-4c76-b106-b6eacecf6823 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:47.753624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:47.766532 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 558/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:38:47.773329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524f64-708d-422b-8f15-c5bfa8da5a83 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:47.879859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524f64-708d-422b-8f15-c5bfa8da5a83 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:47.917103 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60f01e-5f4a-4ca1-bea5-05166414643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:47.917693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f01e-5f4a-4ca1-bea5-05166414643f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:47.917974 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f01e-5f4a-4ca1-bea5-05166414643f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:47.918283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60f01e-5f4a-4ca1-bea5-05166414643f None admin] PATH_INFO: `/v3/projects/efebc85e11db419a88763158037d01f1` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:47.919483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60f01e-5f4a-4ca1-bea5-05166414643f None admin] RBAC: Authorizing `identity:get_project(project_id=efebc85e11db419a88763158037d01f1)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:47.921020 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60f01e-5f4a-4ca1-bea5-05166414643f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:47.924037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 558/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:38:47 2022] GET /identity/v3/projects/efebc85e11db419a88763158037d01f1 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:47.929321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c9a1d-75f9-4c76-b106-b6eacecf6823 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:48.029989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c9a1d-75f9-4c76-b106-b6eacecf6823 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:48.064145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72b9f-47e4-4f9f-95c2-afa1a417bf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:48.064795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72b9f-47e4-4f9f-95c2-afa1a417bf0e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:48.069176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72b9f-47e4-4f9f-95c2-afa1a417bf0e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:48.069176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72b9f-47e4-4f9f-95c2-afa1a417bf0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:48.069176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72b9f-47e4-4f9f-95c2-afa1a417bf0e None admin] RBAC: Adding query filter params (role.id=e5562064df7e4f1a96a35d581b4f28c4, scope.project.id=efebc85e11db419a88763158037d01f1, user.id=fe777272a27c4886a2ea6c8d1a56c021) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:48.069176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72b9f-47e4-4f9f-95c2-afa1a417bf0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:48.069176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72b9f-47e4-4f9f-95c2-afa1a417bf0e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:48.073640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 559/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:47 2022] GET /identity/v3/role_assignments?user.id=fe777272a27c4886a2ea6c8d1a56c021&scope.project.id=efebc85e11db419a88763158037d01f1&role.id=e5562064df7e4f1a96a35d581b4f28c4 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:49.983431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de421a4e-0cbb-4b1a-9660-e042cb9e4c26 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:49.984107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de421a4e-0cbb-4b1a-9660-e042cb9e4c26 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:49.984107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de421a4e-0cbb-4b1a-9660-e042cb9e4c26 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:49.985323 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 559/1118] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:49.991416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29e48f-cc2b-4808-b3a0-296385e6a85a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:49.991839 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29e48f-cc2b-4808-b3a0-296385e6a85a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:49.991952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29e48f-cc2b-4808-b3a0-296385e6a85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:50.010921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-af29e48f-cc2b-4808-b3a0-296385e6a85a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:50.012112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-af29e48f-cc2b-4808-b3a0-296385e6a85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:50.062854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:50.082137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 560/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:38:50.362409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de421a4e-0cbb-4b1a-9660-e042cb9e4c26 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:50.366873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:50.466175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de421a4e-0cbb-4b1a-9660-e042cb9e4c26 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:50.502293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a7070-e7aa-42c7-8420-9457d30125af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:50.502934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a7070-e7aa-42c7-8420-9457d30125af None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:50.503316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a7070-e7aa-42c7-8420-9457d30125af None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:50.503496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a7070-e7aa-42c7-8420-9457d30125af None admin] PATH_INFO: `/v3/roles/e5562064df7e4f1a96a35d581b4f28c4` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:50.504920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a7070-e7aa-42c7-8420-9457d30125af None admin] RBAC: Authorizing `identity:get_role(role_id=e5562064df7e4f1a96a35d581b4f28c4)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:50.506840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a7070-e7aa-42c7-8420-9457d30125af None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:50.508165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 560/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:38:50 2022] GET /identity/v3/roles/e5562064df7e4f1a96a35d581b4f28c4 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:50.514490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29e48f-cc2b-4808-b3a0-296385e6a85a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:50.613975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29e48f-cc2b-4808-b3a0-296385e6a85a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:50.648736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3634cb8-96c6-4f63-bd7a-f8b102ea0c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:50.649365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634cb8-96c6-4f63-bd7a-f8b102ea0c4b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:50.649640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634cb8-96c6-4f63-bd7a-f8b102ea0c4b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:50.649909 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3634cb8-96c6-4f63-bd7a-f8b102ea0c4b None admin] PATH_INFO: `/v3/users/fe777272a27c4886a2ea6c8d1a56c021` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:50.651037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3634cb8-96c6-4f63-bd7a-f8b102ea0c4b None admin] RBAC: Authorizing `identity:get_user(user_id=fe777272a27c4886a2ea6c8d1a56c021)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:50.652692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3634cb8-96c6-4f63-bd7a-f8b102ea0c4b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:50.654308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 561/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:38:50 2022] GET /identity/v3/users/fe777272a27c4886a2ea6c8d1a56c021 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:50.660325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a7070-e7aa-42c7-8420-9457d30125af None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:50.737045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:50.768943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a7070-e7aa-42c7-8420-9457d30125af None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:50.809738 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e79229-5640-4b5b-b434-edf57315f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:50.810369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79229-5640-4b5b-b434-edf57315f8ba None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:50.810650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79229-5640-4b5b-b434-edf57315f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:50.810923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e79229-5640-4b5b-b434-edf57315f8ba None admin] PATH_INFO: `/v3/projects/efebc85e11db419a88763158037d01f1` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:50.812037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e79229-5640-4b5b-b434-edf57315f8ba None admin] RBAC: Authorizing `identity:get_project(project_id=efebc85e11db419a88763158037d01f1)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:50.813493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e79229-5640-4b5b-b434-edf57315f8ba None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:50.815162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 561/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:38:50 2022] GET /identity/v3/projects/efebc85e11db419a88763158037d01f1 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:50.821247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3634cb8-96c6-4f63-bd7a-f8b102ea0c4b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:50.880328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:50.956427 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3634cb8-96c6-4f63-bd7a-f8b102ea0c4b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:51.000135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895e2ff-d01e-44ca-8384-529b1423c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:51.000902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895e2ff-d01e-44ca-8384-529b1423c309 None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:51.001103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895e2ff-d01e-44ca-8384-529b1423c309 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:51.001379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895e2ff-d01e-44ca-8384-529b1423c309 None admin] PATH_INFO: `/v3/projects/efebc85e11db419a88763158037d01f1/users/fe777272a27c4886a2ea6c8d1a56c021/roles/e5562064df7e4f1a96a35d581b4f28c4` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:51.003677 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895e2ff-d01e-44ca-8384-529b1423c309 None admin] RBAC: Authorizing `identity:create_grant(project_id=efebc85e11db419a88763158037d01f1, user_id=fe777272a27c4886a2ea6c8d1a56c021, role_id=e5562064df7e4f1a96a35d581b4f28c4)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:51.005191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895e2ff-d01e-44ca-8384-529b1423c309 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:51.078180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 562/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:38:50 2022] PUT /identity/v3/projects/efebc85e11db419a88763158037d01f1/users/fe777272a27c4886a2ea6c8d1a56c021/roles/e5562064df7e4f1a96a35d581b4f28c4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:38:53.083019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976b96-474c-49ab-8d11-4d0990bdc52a None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:53.083562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976b96-474c-49ab-8d11-4d0990bdc52a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:53.083562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976b96-474c-49ab-8d11-4d0990bdc52a None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:53.085006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 562/1124] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:53.090717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ed5f-5f59-405c-8328-143862e69c94 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:53.091227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ed5f-5f59-405c-8328-143862e69c94 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:53.091227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ed5f-5f59-405c-8328-143862e69c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:53.110366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-74a1ed5f-5f59-405c-8328-143862e69c94 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:53.111563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-74a1ed5f-5f59-405c-8328-143862e69c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:53.199688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 563/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:53.470085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d976b96-474c-49ab-8d11-4d0990bdc52a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:53.574142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d976b96-474c-49ab-8d11-4d0990bdc52a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:53.612216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cf16-d679-4501-9741-9ae7d92d7206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:53.612876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cf16-d679-4501-9741-9ae7d92d7206 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:53.613160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cf16-d679-4501-9741-9ae7d92d7206 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:53.613433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cf16-d679-4501-9741-9ae7d92d7206 None admin] PATH_INFO: `/v3/roles/e5562064df7e4f1a96a35d581b4f28c4` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:53.614838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cf16-d679-4501-9741-9ae7d92d7206 None admin] RBAC: Authorizing `identity:get_role(role_id=e5562064df7e4f1a96a35d581b4f28c4)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:53.616191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cf16-d679-4501-9741-9ae7d92d7206 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:53.617606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 563/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:38:53 2022] GET /identity/v3/roles/e5562064df7e4f1a96a35d581b4f28c4 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:53.623452 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1ed5f-5f59-405c-8328-143862e69c94 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:53.665136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:53.725027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1ed5f-5f59-405c-8328-143862e69c94 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:53.760604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba57c8e-a3a2-4db0-9f46-f5acf005023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:53.761249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba57c8e-a3a2-4db0-9f46-f5acf005023f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:53.761523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba57c8e-a3a2-4db0-9f46-f5acf005023f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:53.761796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba57c8e-a3a2-4db0-9f46-f5acf005023f None admin] PATH_INFO: `/v3/users/fe777272a27c4886a2ea6c8d1a56c021` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:53.762930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba57c8e-a3a2-4db0-9f46-f5acf005023f None admin] RBAC: Authorizing `identity:get_user(user_id=fe777272a27c4886a2ea6c8d1a56c021)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:53.764388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba57c8e-a3a2-4db0-9f46-f5acf005023f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:53.766357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 564/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:38:53 2022] GET /identity/v3/users/fe777272a27c4886a2ea6c8d1a56c021 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:53.772949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cf16-d679-4501-9741-9ae7d92d7206 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:53.784351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:53.882398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cf16-d679-4501-9741-9ae7d92d7206 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:53.922097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf75790-091f-46e9-8430-0dcb2bd99365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:53.922742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75790-091f-46e9-8430-0dcb2bd99365 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:53.923014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75790-091f-46e9-8430-0dcb2bd99365 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:53.923278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf75790-091f-46e9-8430-0dcb2bd99365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:54.004405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf75790-091f-46e9-8430-0dcb2bd99365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:54.006371 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf75790-091f-46e9-8430-0dcb2bd99365 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:54.016478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:54.117053 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 564/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:38:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:38:54.124591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba57c8e-a3a2-4db0-9f46-f5acf005023f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:54.230748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba57c8e-a3a2-4db0-9f46-f5acf005023f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:54.241167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:54.266647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a5456-3855-40be-b7fe-45c95ae72391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:54.267203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a5456-3855-40be-b7fe-45c95ae72391 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:54.267479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a5456-3855-40be-b7fe-45c95ae72391 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:54.267749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a5456-3855-40be-b7fe-45c95ae72391 None admin] PATH_INFO: `/v3/projects/efebc85e11db419a88763158037d01f1` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:54.268897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a5456-3855-40be-b7fe-45c95ae72391 None admin] RBAC: Authorizing `identity:get_project(project_id=efebc85e11db419a88763158037d01f1)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:54.270355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a5456-3855-40be-b7fe-45c95ae72391 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:54.271999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 565/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:38:54 2022] GET /identity/v3/projects/efebc85e11db419a88763158037d01f1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:54.278420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf75790-091f-46e9-8430-0dcb2bd99365 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:54.381780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf75790-091f-46e9-8430-0dcb2bd99365 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:54.391261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:54.428357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c352e-47fe-4083-87ab-11be572104d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:54.429004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c352e-47fe-4083-87ab-11be572104d1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:54.429286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c352e-47fe-4083-87ab-11be572104d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:54.429600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c352e-47fe-4083-87ab-11be572104d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:54.430340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c352e-47fe-4083-87ab-11be572104d1 None admin] RBAC: Adding query filter params (role.id=e5562064df7e4f1a96a35d581b4f28c4, scope.project.id=efebc85e11db419a88763158037d01f1, user.id=fe777272a27c4886a2ea6c8d1a56c021) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:38:54.430645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c352e-47fe-4083-87ab-11be572104d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:54.432125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c352e-47fe-4083-87ab-11be572104d1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:54.439026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 565/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:38:54 2022] GET /identity/v3/role_assignments?user.id=fe777272a27c4886a2ea6c8d1a56c021&scope.project.id=efebc85e11db419a88763158037d01f1&role.id=e5562064df7e4f1a96a35d581b4f28c4 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:56.436424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7649c-ac9a-42b4-a538-3a57a7499858 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:56.437152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7649c-ac9a-42b4-a538-3a57a7499858 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:56.437152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7649c-ac9a-42b4-a538-3a57a7499858 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:56.438376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 566/1131] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:56.443568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1878ead-d39a-47d8-abe6-0e8d27c09d15 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:56.443973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1878ead-d39a-47d8-abe6-0e8d27c09d15 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:56.444096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1878ead-d39a-47d8-abe6-0e8d27c09d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:56.462287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e1878ead-d39a-47d8-abe6-0e8d27c09d15 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:56.463468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e1878ead-d39a-47d8-abe6-0e8d27c09d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:56.533081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 566/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:56.812217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7649c-ac9a-42b4-a538-3a57a7499858 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:56.929252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7649c-ac9a-42b4-a538-3a57a7499858 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:56.976749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccdda7-470f-4bd9-b830-9b7f8a853790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:56.976749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccdda7-470f-4bd9-b830-9b7f8a853790 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:56.976749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccdda7-470f-4bd9-b830-9b7f8a853790 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:56.976749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccdda7-470f-4bd9-b830-9b7f8a853790 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:56.977327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccdda7-470f-4bd9-b830-9b7f8a853790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:56.977327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccdda7-470f-4bd9-b830-9b7f8a853790 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:56.978055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 567/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:38:56.990541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1878ead-d39a-47d8-abe6-0e8d27c09d15 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:57.096615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1878ead-d39a-47d8-abe6-0e8d27c09d15 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:57.098178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:57.134409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6ab1e-0677-454e-ae71-1a7de93185b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:57.135026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6ab1e-0677-454e-ae71-1a7de93185b9 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:57.135300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6ab1e-0677-454e-ae71-1a7de93185b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:57.135568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6ab1e-0677-454e-ae71-1a7de93185b9 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:57.136279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6ab1e-0677-454e-ae71-1a7de93185b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:57.137781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6ab1e-0677-454e-ae71-1a7de93185b9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:57.242288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 567/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:38:56 2022] POST /identity/v3/projects => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:38:59.305854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34b8f0-9f4e-4e57-a237-adf75d009cf2 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:59.306432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34b8f0-9f4e-4e57-a237-adf75d009cf2 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:59.306432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34b8f0-9f4e-4e57-a237-adf75d009cf2 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:59.307759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 568/1135] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:38:59.313609 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30fcd-258a-4fb8-ace8-711845214771 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:59.314135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30fcd-258a-4fb8-ace8-711845214771 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:59.314135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b30fcd-258a-4fb8-ace8-711845214771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:59.338346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-15b30fcd-258a-4fb8-ace8-711845214771 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:38:59.338346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-15b30fcd-258a-4fb8-ace8-711845214771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:38:59.406939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 568/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:38:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:38:59.679257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34b8f0-9f4e-4e57-a237-adf75d009cf2 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:59.736955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:59.794547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34b8f0-9f4e-4e57-a237-adf75d009cf2 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:38:59.829683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42409756-85f4-4c09-b549-be6d0c8d4884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:38:59.830295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42409756-85f4-4c09-b549-be6d0c8d4884 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:38:59.830573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42409756-85f4-4c09-b549-be6d0c8d4884 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:38:59.830849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42409756-85f4-4c09-b549-be6d0c8d4884 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:38:59.832160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42409756-85f4-4c09-b549-be6d0c8d4884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:38:59.834212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42409756-85f4-4c09-b549-be6d0c8d4884 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:38:59.835833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 569/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:38:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:38:59.845094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b30fcd-258a-4fb8-ace8-711845214771 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:38:59.949120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:38:59.967130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b30fcd-258a-4fb8-ace8-711845214771 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:00.004025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c87d0-b270-4a9a-8348-10520a455fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:00.005239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c87d0-b270-4a9a-8348-10520a455fcb None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:00.005514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c87d0-b270-4a9a-8348-10520a455fcb None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:00.005777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c87d0-b270-4a9a-8348-10520a455fcb None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:00.006485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c87d0-b270-4a9a-8348-10520a455fcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:00.007888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c87d0-b270-4a9a-8348-10520a455fcb None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:00.120445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 569/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:38:59 2022] POST /identity/v3/users => generated 286 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:39:02.113390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b96fc-2fc6-4d67-b1d8-5017dd6f83ae None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:02.113991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b96fc-2fc6-4d67-b1d8-5017dd6f83ae None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:02.113991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b96fc-2fc6-4d67-b1d8-5017dd6f83ae None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:02.115282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 570/1139] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:39:02.121136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371f378-57ad-4c10-844e-566899783c97 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:02.121638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371f378-57ad-4c10-844e-566899783c97 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:02.121759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371f378-57ad-4c10-844e-566899783c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:02.141186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d371f378-57ad-4c10-844e-566899783c97 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:39:02.142409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d371f378-57ad-4c10-844e-566899783c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:39:02.216926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 570/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:39:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:39:02.490892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b96fc-2fc6-4d67-b1d8-5017dd6f83ae None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:02.599928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b96fc-2fc6-4d67-b1d8-5017dd6f83ae None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:02.614583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:02.638009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab6447-a686-49e3-973b-5007a9f5b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:02.638645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6447-a686-49e3-973b-5007a9f5b63c None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:02.638918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6447-a686-49e3-973b-5007a9f5b63c None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:02.639187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6447-a686-49e3-973b-5007a9f5b63c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:02.650155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6447-a686-49e3-973b-5007a9f5b63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-00ab6447-a686-49e3-973b-5007a9f5b63c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:39:02.655050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:39:02.656100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:39:02.657073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 571/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:39:02.663223 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371f378-57ad-4c10-844e-566899783c97 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:02.741981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:02.775169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371f378-57ad-4c10-844e-566899783c97 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:02.821594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a40520-c01c-4cd8-9395-a79485d69939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:02.822245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a40520-c01c-4cd8-9395-a79485d69939 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:02.822524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a40520-c01c-4cd8-9395-a79485d69939 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:02.822799 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a40520-c01c-4cd8-9395-a79485d69939 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:02.823524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a40520-c01c-4cd8-9395-a79485d69939 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:02.823830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a40520-c01c-4cd8-9395-a79485d69939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:02.825265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a40520-c01c-4cd8-9395-a79485d69939 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:02.835167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 571/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:39:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:02.841441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab6447-a686-49e3-973b-5007a9f5b63c None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:02.955809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab6447-a686-49e3-973b-5007a9f5b63c None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:02.994948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134b318-3076-4587-b496-35b95bd039df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:02.995571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134b318-3076-4587-b496-35b95bd039df None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:02.995894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134b318-3076-4587-b496-35b95bd039df None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:02.996214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134b318-3076-4587-b496-35b95bd039df None admin] PATH_INFO: `/v3/users/87f0edfa8a094c3bb62d85466a0f452e` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:03.013353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134b318-3076-4587-b496-35b95bd039df None admin] RBAC: Authorizing `identity:get_user(user_id=87f0edfa8a094c3bb62d85466a0f452e)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:03.014826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134b318-3076-4587-b496-35b95bd039df None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:03.016581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 572/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:39:02 2022] GET /identity/v3/users/87f0edfa8a094c3bb62d85466a0f452e => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:03.022992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a40520-c01c-4cd8-9395-a79485d69939 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:03.140547 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a40520-c01c-4cd8-9395-a79485d69939 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:03.174403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:03.180105 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6d873-5228-46cc-8d42-925312f640e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:03.180757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d873-5228-46cc-8d42-925312f640e9 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:03.187178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d873-5228-46cc-8d42-925312f640e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:03.187178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6d873-5228-46cc-8d42-925312f640e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:03.251932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6d873-5228-46cc-8d42-925312f640e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:03.253347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6d873-5228-46cc-8d42-925312f640e9 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:03.360962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 572/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:39:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:39:03.367748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134b318-3076-4587-b496-35b95bd039df None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:03.400767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:03.481214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134b318-3076-4587-b496-35b95bd039df None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:03.516562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d360d6-fe90-4c35-8556-bcb5528c26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:03.517127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d360d6-fe90-4c35-8556-bcb5528c26a3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:03.517406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d360d6-fe90-4c35-8556-bcb5528c26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:03.517679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d360d6-fe90-4c35-8556-bcb5528c26a3 None admin] PATH_INFO: `/v3/projects/575eb9044e474d238b6d0e22a4faf463` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:03.518815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d360d6-fe90-4c35-8556-bcb5528c26a3 None admin] RBAC: Authorizing `identity:get_project(project_id=575eb9044e474d238b6d0e22a4faf463)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:03.520290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d360d6-fe90-4c35-8556-bcb5528c26a3 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:03.521985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 573/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:39:03 2022] GET /identity/v3/projects/575eb9044e474d238b6d0e22a4faf463 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:03.528494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6d873-5228-46cc-8d42-925312f640e9 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:03.566562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:03.642270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6d873-5228-46cc-8d42-925312f640e9 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:03.679238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ef853-15c2-4d9d-9cb4-e5a08878f591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:03.679841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ef853-15c2-4d9d-9cb4-e5a08878f591 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:03.680112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ef853-15c2-4d9d-9cb4-e5a08878f591 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:03.680375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ef853-15c2-4d9d-9cb4-e5a08878f591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:03.681136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ef853-15c2-4d9d-9cb4-e5a08878f591 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=575eb9044e474d238b6d0e22a4faf463, user.id=87f0edfa8a094c3bb62d85466a0f452e) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:03.681437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ef853-15c2-4d9d-9cb4-e5a08878f591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:03.682872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ef853-15c2-4d9d-9cb4-e5a08878f591 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:03.688948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 573/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:39:03 2022] GET /identity/v3/role_assignments?user.id=87f0edfa8a094c3bb62d85466a0f452e&scope.project.id=575eb9044e474d238b6d0e22a4faf463&role.id=eeb6551eeb934053866fc821b511b5dd => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:05.663856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1a3e8-110a-4d81-865c-c926e41871c1 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:05.664395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1a3e8-110a-4d81-865c-c926e41871c1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:05.664395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1a3e8-110a-4d81-865c-c926e41871c1 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:05.665831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 574/1147] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:39:05.671235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eb714-b904-48de-8bf3-f587ddb50bc7 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:05.671695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eb714-b904-48de-8bf3-f587ddb50bc7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:05.671806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eb714-b904-48de-8bf3-f587ddb50bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:05.690982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-812eb714-b904-48de-8bf3-f587ddb50bc7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:39:05.692214 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-812eb714-b904-48de-8bf3-f587ddb50bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:39:05.767435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 574/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:39:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:39:06.058766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1a3e8-110a-4d81-865c-c926e41871c1 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:06.169672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:06.177900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1a3e8-110a-4d81-865c-c926e41871c1 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:06.221268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e4db7-3da6-4912-b99c-528fa673dcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:06.222192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e4db7-3da6-4912-b99c-528fa673dcf9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:06.222627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e4db7-3da6-4912-b99c-528fa673dcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:06.223613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e4db7-3da6-4912-b99c-528fa673dcf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:06.238530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e4db7-3da6-4912-b99c-528fa673dcf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-e92e4db7-3da6-4912-b99c-528fa673dcf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:39:06.243298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:39:06.248882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:39:06.249952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 575/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:39:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:39:06.251065 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eb714-b904-48de-8bf3-f587ddb50bc7 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:06.281184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:06.361650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eb714-b904-48de-8bf3-f587ddb50bc7 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:06.398084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57afe6a-dff8-4574-a402-2978d3dc8252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:06.398708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57afe6a-dff8-4574-a402-2978d3dc8252 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:06.398981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57afe6a-dff8-4574-a402-2978d3dc8252 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:06.399252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57afe6a-dff8-4574-a402-2978d3dc8252 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:06.399918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57afe6a-dff8-4574-a402-2978d3dc8252 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:06.400222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57afe6a-dff8-4574-a402-2978d3dc8252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:06.401656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57afe6a-dff8-4574-a402-2978d3dc8252 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:06.410796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 575/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:39:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:06.417768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e4db7-3da6-4912-b99c-528fa673dcf9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:06.524497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e4db7-3da6-4912-b99c-528fa673dcf9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:06.560540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71731a9a-c234-44a0-9bbb-0612ae79137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:06.561193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71731a9a-c234-44a0-9bbb-0612ae79137b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:06.561472 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71731a9a-c234-44a0-9bbb-0612ae79137b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:06.561743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71731a9a-c234-44a0-9bbb-0612ae79137b None admin] PATH_INFO: `/v3/users/87f0edfa8a094c3bb62d85466a0f452e` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:06.562881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71731a9a-c234-44a0-9bbb-0612ae79137b None admin] RBAC: Authorizing `identity:get_user(user_id=87f0edfa8a094c3bb62d85466a0f452e)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:06.564324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71731a9a-c234-44a0-9bbb-0612ae79137b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:06.566006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 576/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:39:06 2022] GET /identity/v3/users/87f0edfa8a094c3bb62d85466a0f452e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:06.576067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57afe6a-dff8-4574-a402-2978d3dc8252 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:06.687908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:06.701029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57afe6a-dff8-4574-a402-2978d3dc8252 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:06.739762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e299b1-dd60-4901-8018-e13c13c4e23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:06.739762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e299b1-dd60-4901-8018-e13c13c4e23c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:06.739762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e299b1-dd60-4901-8018-e13c13c4e23c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:06.739762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e299b1-dd60-4901-8018-e13c13c4e23c None admin] PATH_INFO: `/v3/projects/575eb9044e474d238b6d0e22a4faf463` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:06.740234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e299b1-dd60-4901-8018-e13c13c4e23c None admin] RBAC: Authorizing `identity:get_project(project_id=575eb9044e474d238b6d0e22a4faf463)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:06.741544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e299b1-dd60-4901-8018-e13c13c4e23c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:06.743250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 576/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:39:06 2022] GET /identity/v3/projects/575eb9044e474d238b6d0e22a4faf463 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:06.749508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71731a9a-c234-44a0-9bbb-0612ae79137b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:06.780419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:06.868550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71731a9a-c234-44a0-9bbb-0612ae79137b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:06.904400 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d9757-ba0c-4b34-b721-3fba4781b4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:06.905096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d9757-ba0c-4b34-b721-3fba4781b4d9 None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:06.905380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d9757-ba0c-4b34-b721-3fba4781b4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:06.905651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d9757-ba0c-4b34-b721-3fba4781b4d9 None admin] PATH_INFO: `/v3/projects/575eb9044e474d238b6d0e22a4faf463/users/87f0edfa8a094c3bb62d85466a0f452e/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:06.907583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d9757-ba0c-4b34-b721-3fba4781b4d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=575eb9044e474d238b6d0e22a4faf463, user_id=87f0edfa8a094c3bb62d85466a0f452e, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:06.909066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d9757-ba0c-4b34-b721-3fba4781b4d9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:07.023466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 577/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:39:06 2022] PUT /identity/v3/projects/575eb9044e474d238b6d0e22a4faf463/users/87f0edfa8a094c3bb62d85466a0f452e/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:39:08.950577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf077-01c6-4b51-b1a5-7e5b91512fdf None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:08.951181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf077-01c6-4b51-b1a5-7e5b91512fdf None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:08.951181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf077-01c6-4b51-b1a5-7e5b91512fdf None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:08.952436 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 577/1154] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:39:08.957780 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea465909-c8c6-48e4-a5fb-302fb42788fd None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:08.958231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea465909-c8c6-48e4-a5fb-302fb42788fd None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:08.958405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea465909-c8c6-48e4-a5fb-302fb42788fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:08.983235 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-ea465909-c8c6-48e4-a5fb-302fb42788fd None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:39:08.984487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ea465909-c8c6-48e4-a5fb-302fb42788fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:39:09.053462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 578/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:39:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:39:09.317560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaf077-01c6-4b51-b1a5-7e5b91512fdf None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:09.434635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaf077-01c6-4b51-b1a5-7e5b91512fdf None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:09.492414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79ffa-f825-4669-b825-8dea63c032e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:09.493501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79ffa-f825-4669-b825-8dea63c032e0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:09.493989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79ffa-f825-4669-b825-8dea63c032e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:09.494473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79ffa-f825-4669-b825-8dea63c032e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:09.513287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79ffa-f825-4669-b825-8dea63c032e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-00d79ffa-f825-4669-b825-8dea63c032e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:39:09.523519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:39:09.524889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:09.525971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:39:09.527025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 578/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:39:09.532330 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea465909-c8c6-48e4-a5fb-302fb42788fd None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:09.553584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:09.657770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea465909-c8c6-48e4-a5fb-302fb42788fd None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:09.692695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b18837-488d-4a1c-bd35-5372c31d3541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:09.693310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b18837-488d-4a1c-bd35-5372c31d3541 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:09.693591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b18837-488d-4a1c-bd35-5372c31d3541 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:09.693864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b18837-488d-4a1c-bd35-5372c31d3541 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:09.694532 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b18837-488d-4a1c-bd35-5372c31d3541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:09.694835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b18837-488d-4a1c-bd35-5372c31d3541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:09.696213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b18837-488d-4a1c-bd35-5372c31d3541 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:09.704739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 579/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:39:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:09.712277 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79ffa-f825-4669-b825-8dea63c032e0 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:09.734304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:09.822481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79ffa-f825-4669-b825-8dea63c032e0 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:09.858430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2610358-9368-4e60-8185-61afc6500419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:09.859064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2610358-9368-4e60-8185-61afc6500419 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:09.859342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2610358-9368-4e60-8185-61afc6500419 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:09.859613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2610358-9368-4e60-8185-61afc6500419 None admin] PATH_INFO: `/v3/users/87f0edfa8a094c3bb62d85466a0f452e` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:09.860925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2610358-9368-4e60-8185-61afc6500419 None admin] RBAC: Authorizing `identity:get_user(user_id=87f0edfa8a094c3bb62d85466a0f452e)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:09.862361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2610358-9368-4e60-8185-61afc6500419 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:09.864472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 579/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:39:09 2022] GET /identity/v3/users/87f0edfa8a094c3bb62d85466a0f452e => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:09.870750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b18837-488d-4a1c-bd35-5372c31d3541 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:09.952905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:09.982224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b18837-488d-4a1c-bd35-5372c31d3541 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:10.016003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4d6a0-d522-43d4-b590-f46a89c16d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:10.016919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4d6a0-d522-43d4-b590-f46a89c16d76 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:10.017237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4d6a0-d522-43d4-b590-f46a89c16d76 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:10.017518 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4d6a0-d522-43d4-b590-f46a89c16d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:10.088977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4d6a0-d522-43d4-b590-f46a89c16d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:10.090425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4d6a0-d522-43d4-b590-f46a89c16d76 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:10.173267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:10.198005 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 580/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:39:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:39:10.204345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2610358-9368-4e60-8185-61afc6500419 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:10.296486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:10.321884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2610358-9368-4e60-8185-61afc6500419 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:10.357188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f40bfb-dc09-4535-a93c-d7023178faca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:10.357815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f40bfb-dc09-4535-a93c-d7023178faca None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:10.358089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f40bfb-dc09-4535-a93c-d7023178faca None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:10.358358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f40bfb-dc09-4535-a93c-d7023178faca None admin] PATH_INFO: `/v3/projects/575eb9044e474d238b6d0e22a4faf463` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:10.359489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f40bfb-dc09-4535-a93c-d7023178faca None admin] RBAC: Authorizing `identity:get_project(project_id=575eb9044e474d238b6d0e22a4faf463)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:10.360960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f40bfb-dc09-4535-a93c-d7023178faca None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:10.362606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 580/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:39:10 2022] GET /identity/v3/projects/575eb9044e474d238b6d0e22a4faf463 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:10.368862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4d6a0-d522-43d4-b590-f46a89c16d76 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:10.469467 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4d6a0-d522-43d4-b590-f46a89c16d76 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:10.506255 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383006a4-e423-4dcc-8dcb-16dbe9191bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:10.506877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383006a4-e423-4dcc-8dcb-16dbe9191bee None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:10.507269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383006a4-e423-4dcc-8dcb-16dbe9191bee None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:10.507687 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383006a4-e423-4dcc-8dcb-16dbe9191bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:10.508773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383006a4-e423-4dcc-8dcb-16dbe9191bee None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=575eb9044e474d238b6d0e22a4faf463, user.id=87f0edfa8a094c3bb62d85466a0f452e) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:10.509309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383006a4-e423-4dcc-8dcb-16dbe9191bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:10.511344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383006a4-e423-4dcc-8dcb-16dbe9191bee None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:10.517818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 581/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:39:10 2022] GET /identity/v3/role_assignments?user.id=87f0edfa8a094c3bb62d85466a0f452e&scope.project.id=575eb9044e474d238b6d0e22a4faf463&role.id=eeb6551eeb934053866fc821b511b5dd => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:12.516479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604412e-46dd-4deb-b4b3-aa2e6b62a746 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:12.517086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604412e-46dd-4deb-b4b3-aa2e6b62a746 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:12.517086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604412e-46dd-4deb-b4b3-aa2e6b62a746 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:12.518425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 581/1162] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:39:12.524191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f2fcf-9ae3-4ba0-8a51-36dfd0b6ce78 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:12.524757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f2fcf-9ae3-4ba0-8a51-36dfd0b6ce78 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:12.524757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f2fcf-9ae3-4ba0-8a51-36dfd0b6ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:12.544640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-6c6f2fcf-9ae3-4ba0-8a51-36dfd0b6ce78 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:39:12.545881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6c6f2fcf-9ae3-4ba0-8a51-36dfd0b6ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:39:12.588538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:12.626581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 582/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:39:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:39:12.897304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604412e-46dd-4deb-b4b3-aa2e6b62a746 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:13.015287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604412e-46dd-4deb-b4b3-aa2e6b62a746 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:13.052989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6981-0271-4f46-8df7-47f4d8305dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:13.053713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6981-0271-4f46-8df7-47f4d8305dd2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:13.053991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6981-0271-4f46-8df7-47f4d8305dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:13.054261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6981-0271-4f46-8df7-47f4d8305dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:13.078691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:13.129531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c6981-0271-4f46-8df7-47f4d8305dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:13.131124 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c6981-0271-4f46-8df7-47f4d8305dd2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:13.247810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 582/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:39:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:39:13.254770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f2fcf-9ae3-4ba0-8a51-36dfd0b6ce78 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:13.356262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f2fcf-9ae3-4ba0-8a51-36dfd0b6ce78 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:13.390899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebf142-cd5b-4bff-a5aa-a8bfd8d62322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:13.391542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebf142-cd5b-4bff-a5aa-a8bfd8d62322 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:13.391821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebf142-cd5b-4bff-a5aa-a8bfd8d62322 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:13.392092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebf142-cd5b-4bff-a5aa-a8bfd8d62322 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:13.399767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebf142-cd5b-4bff-a5aa-a8bfd8d62322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:13.401248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebf142-cd5b-4bff-a5aa-a8bfd8d62322 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-cdebf142-cd5b-4bff-a5aa-a8bfd8d62322 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:39:13.412718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:39:13.414040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:39:13.414904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 583/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 15:39:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:39:13.420074 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6981-0271-4f46-8df7-47f4d8305dd2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:13.477414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:13.529467 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6981-0271-4f46-8df7-47f4d8305dd2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:13.565052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2c4c5-f7fc-49db-9eff-344707324b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:13.565659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c4c5-f7fc-49db-9eff-344707324b77 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:13.565959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c4c5-f7fc-49db-9eff-344707324b77 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:13.566801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2c4c5-f7fc-49db-9eff-344707324b77 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:13.568178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2c4c5-f7fc-49db-9eff-344707324b77 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:13.568484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2c4c5-f7fc-49db-9eff-344707324b77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:13.569881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2c4c5-f7fc-49db-9eff-344707324b77 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:13.577219 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 583/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 15:39:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:15.521358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e8727-35bd-428a-af70-5974155808f1 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:15.521972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e8727-35bd-428a-af70-5974155808f1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:15.521972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e8727-35bd-428a-af70-5974155808f1 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:15.523361 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 584/1167] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:39:15.534264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b962a-3877-4383-92d2-2dd72e949c52 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:15.535325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b962a-3877-4383-92d2-2dd72e949c52 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:15.535325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b962a-3877-4383-92d2-2dd72e949c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:15.554558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b53b962a-3877-4383-92d2-2dd72e949c52 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:39:15.555800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b53b962a-3877-4383-92d2-2dd72e949c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:39:15.624936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 584/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:39:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:39:15.895414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e8727-35bd-428a-af70-5974155808f1 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:15.928022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:16.001514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e8727-35bd-428a-af70-5974155808f1 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:16.038418 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653423b-e22c-4d40-aacd-e39e8476aeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:16.039030 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653423b-e22c-4d40-aacd-e39e8476aeed None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:16.039306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653423b-e22c-4d40-aacd-e39e8476aeed None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:16.039723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653423b-e22c-4d40-aacd-e39e8476aeed None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:16.040381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653423b-e22c-4d40-aacd-e39e8476aeed None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:16.041782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653423b-e22c-4d40-aacd-e39e8476aeed None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:16.143858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 585/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Mon Aug 22 15:39:15 2022] POST /identity/v3/domains => generated 267 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:39:18.142589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f1742-59fc-4963-9b9e-3aae63bb0cfa None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:18.143156 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f1742-59fc-4963-9b9e-3aae63bb0cfa None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:18.143156 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f1742-59fc-4963-9b9e-3aae63bb0cfa None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:18.144645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 585/1170] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:39:18.153054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845ac33-963a-4f16-9c3d-ed8c083829d6 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:18.154068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845ac33-963a-4f16-9c3d-ed8c083829d6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:18.154068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845ac33-963a-4f16-9c3d-ed8c083829d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:18.173064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3845ac33-963a-4f16-9c3d-ed8c083829d6 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:39:18.174501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3845ac33-963a-4f16-9c3d-ed8c083829d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:39:18.254790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 586/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:39:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:39:18.526188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f1742-59fc-4963-9b9e-3aae63bb0cfa None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:18.578499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:18.634769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f1742-59fc-4963-9b9e-3aae63bb0cfa None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:18.671377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a00b7-4440-44f6-83a3-9515c332f325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:18.672005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a00b7-4440-44f6-83a3-9515c332f325 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:18.672277 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a00b7-4440-44f6-83a3-9515c332f325 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:18.672573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a00b7-4440-44f6-83a3-9515c332f325 None admin] PATH_INFO: `/v3/domains/b803cbc2d3f048beabe9e2da5bccc59d` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:18.684160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a00b7-4440-44f6-83a3-9515c332f325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b803cbc2d3f048beabe9e2da5bccc59d)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:18.685702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a00b7-4440-44f6-83a3-9515c332f325 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:18.687388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 586/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Aug 22 15:39:18 2022] GET /identity/v3/domains/b803cbc2d3f048beabe9e2da5bccc59d => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:18.693385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845ac33-963a-4f16-9c3d-ed8c083829d6 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:18.717920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:18.805702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845ac33-963a-4f16-9c3d-ed8c083829d6 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:18.843796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153da955-0940-47fe-8715-b84d4178a2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:18.844423 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153da955-0940-47fe-8715-b84d4178a2a9 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:18.844763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153da955-0940-47fe-8715-b84d4178a2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:18.845052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153da955-0940-47fe-8715-b84d4178a2a9 None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:18.845688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153da955-0940-47fe-8715-b84d4178a2a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:18.847792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153da955-0940-47fe-8715-b84d4178a2a9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:18.965609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 587/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:39:18 2022] POST /identity/v3/projects => generated 361 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:39:20.951206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072693f2-ee5a-4038-8270-1c93ce2ccad6 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:20.951788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072693f2-ee5a-4038-8270-1c93ce2ccad6 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:20.951788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072693f2-ee5a-4038-8270-1c93ce2ccad6 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:20.953110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 587/1174] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:39:20.960164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea1c6-f25d-4714-9961-6d49dcd7663a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:20.960796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea1c6-f25d-4714-9961-6d49dcd7663a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:20.960796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea1c6-f25d-4714-9961-6d49dcd7663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:20.979812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0d1ea1c6-f25d-4714-9961-6d49dcd7663a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:39:20.981079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0d1ea1c6-f25d-4714-9961-6d49dcd7663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:39:21.051351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 588/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:39:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:39:21.323087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072693f2-ee5a-4038-8270-1c93ce2ccad6 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:21.441884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072693f2-ee5a-4038-8270-1c93ce2ccad6 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:21.449504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:21.482034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa88dc-77fe-4866-95b1-182e2fe31ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:21.482997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa88dc-77fe-4866-95b1-182e2fe31ffb None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:21.483430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa88dc-77fe-4866-95b1-182e2fe31ffb None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:21.484009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa88dc-77fe-4866-95b1-182e2fe31ffb None admin] PATH_INFO: `/v3/domains/b803cbc2d3f048beabe9e2da5bccc59d` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:21.485181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa88dc-77fe-4866-95b1-182e2fe31ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=b803cbc2d3f048beabe9e2da5bccc59d)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:21.486607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa88dc-77fe-4866-95b1-182e2fe31ffb None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:21.488791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 588/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Aug 22 15:39:21 2022] GET /identity/v3/domains/b803cbc2d3f048beabe9e2da5bccc59d => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:21.495005 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea1c6-f25d-4714-9961-6d49dcd7663a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:21.498041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:21.611838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea1c6-f25d-4714-9961-6d49dcd7663a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:21.649440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc8f73-362d-48c6-9116-a085317fa087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:21.650037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc8f73-362d-48c6-9116-a085317fa087 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:21.650325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc8f73-362d-48c6-9116-a085317fa087 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:21.650600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc8f73-362d-48c6-9116-a085317fa087 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:21.651341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc8f73-362d-48c6-9116-a085317fa087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:21.652763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc8f73-362d-48c6-9116-a085317fa087 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:21.777272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 589/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:39:21 2022] POST /identity/v3/users => generated 311 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:39:23.780239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb285-de7f-465d-8f68-bdbee4d42a8a None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:23.780844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb285-de7f-465d-8f68-bdbee4d42a8a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:23.780844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb285-de7f-465d-8f68-bdbee4d42a8a None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:23.782439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 589/1178] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:39:23.791288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fc79f-8eaa-4750-81e5-4fe292403420 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:23.791766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fc79f-8eaa-4750-81e5-4fe292403420 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:23.792258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fc79f-8eaa-4750-81e5-4fe292403420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:23.813604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3c5fc79f-8eaa-4750-81e5-4fe292403420 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:39:23.814902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3c5fc79f-8eaa-4750-81e5-4fe292403420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:39:23.886793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:23.898449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 590/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:39:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:39:24.167404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb285-de7f-465d-8f68-bdbee4d42a8a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:24.280374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb285-de7f-465d-8f68-bdbee4d42a8a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:24.318257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd307fc-1404-4887-800e-2727734b7bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:24.318890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd307fc-1404-4887-800e-2727734b7bb4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:24.319162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd307fc-1404-4887-800e-2727734b7bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:24.319426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd307fc-1404-4887-800e-2727734b7bb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:24.330419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd307fc-1404-4887-800e-2727734b7bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-edd307fc-1404-4887-800e-2727734b7bb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:39:24.335305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:39:24.337260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:39:24.338920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 590/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:39:24.343087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fc79f-8eaa-4750-81e5-4fe292403420 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:24.457390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fc79f-8eaa-4750-81e5-4fe292403420 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:24.493998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e25e2f-eb0a-4251-adf5-e7a649a2db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:24.494612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25e2f-eb0a-4251-adf5-e7a649a2db8e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:24.494891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25e2f-eb0a-4251-adf5-e7a649a2db8e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:24.495162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25e2f-eb0a-4251-adf5-e7a649a2db8e None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:24.495825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e25e2f-eb0a-4251-adf5-e7a649a2db8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:24.496126 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e25e2f-eb0a-4251-adf5-e7a649a2db8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:24.497531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e25e2f-eb0a-4251-adf5-e7a649a2db8e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:24.505956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 591/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:24.512008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd307fc-1404-4887-800e-2727734b7bb4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:24.547375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:24.623274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd307fc-1404-4887-800e-2727734b7bb4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:24.664176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0e950-b4b2-4e29-a672-85009f136d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:24.664832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0e950-b4b2-4e29-a672-85009f136d52 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:24.665109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0e950-b4b2-4e29-a672-85009f136d52 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:24.665374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0e950-b4b2-4e29-a672-85009f136d52 None admin] PATH_INFO: `/v3/users/ed304c124f834811b4e9b07f414b94a6` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:24.680390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0e950-b4b2-4e29-a672-85009f136d52 None admin] RBAC: Authorizing `identity:get_user(user_id=ed304c124f834811b4e9b07f414b94a6)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:24.681867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0e950-b4b2-4e29-a672-85009f136d52 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:24.683543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 591/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:39:24 2022] GET /identity/v3/users/ed304c124f834811b4e9b07f414b94a6 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:24.689693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e25e2f-eb0a-4251-adf5-e7a649a2db8e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:24.744843 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:24.795128 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e25e2f-eb0a-4251-adf5-e7a649a2db8e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:24.828840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d75d4e-ba2b-4413-9548-acd91915eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:24.829572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75d4e-ba2b-4413-9548-acd91915eba1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:24.829896 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75d4e-ba2b-4413-9548-acd91915eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:24.830197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75d4e-ba2b-4413-9548-acd91915eba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:24.905296 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d75d4e-ba2b-4413-9548-acd91915eba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:24.906798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d75d4e-ba2b-4413-9548-acd91915eba1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:24.971278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:25.023640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 592/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:39:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:39:25.029860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0e950-b4b2-4e29-a672-85009f136d52 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:25.131709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:25.144578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0e950-b4b2-4e29-a672-85009f136d52 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:25.182685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f129b-a544-4783-8fc9-3fe9d0c5b3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:25.183348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f129b-a544-4783-8fc9-3fe9d0c5b3fe None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:25.183624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f129b-a544-4783-8fc9-3fe9d0c5b3fe None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:25.183897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f129b-a544-4783-8fc9-3fe9d0c5b3fe None admin] PATH_INFO: `/v3/projects/8ffe4c8f1c3b4df582cc49773ed47262` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:25.185514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f129b-a544-4783-8fc9-3fe9d0c5b3fe None admin] RBAC: Authorizing `identity:get_project(project_id=8ffe4c8f1c3b4df582cc49773ed47262)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:25.187100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f129b-a544-4783-8fc9-3fe9d0c5b3fe None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:25.188867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 592/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:39:25 2022] GET /identity/v3/projects/8ffe4c8f1c3b4df582cc49773ed47262 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:25.195682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d75d4e-ba2b-4413-9548-acd91915eba1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:25.310291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d75d4e-ba2b-4413-9548-acd91915eba1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:25.350901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fc41e-8669-481b-bc07-fb95b0074f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:25.351548 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fc41e-8669-481b-bc07-fb95b0074f09 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:25.351833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fc41e-8669-481b-bc07-fb95b0074f09 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:25.352098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fc41e-8669-481b-bc07-fb95b0074f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:25.352882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fc41e-8669-481b-bc07-fb95b0074f09 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=8ffe4c8f1c3b4df582cc49773ed47262, user.id=ed304c124f834811b4e9b07f414b94a6) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:25.353193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fc41e-8669-481b-bc07-fb95b0074f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:25.354654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fc41e-8669-481b-bc07-fb95b0074f09 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:25.360964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 593/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:39:25 2022] GET /identity/v3/role_assignments?user.id=ed304c124f834811b4e9b07f414b94a6&scope.project.id=8ffe4c8f1c3b4df582cc49773ed47262&role.id=eeb6551eeb934053866fc821b511b5dd => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:27.294382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a971-f9e8-4360-a12b-16621dc157ac None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:27.294931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a971-f9e8-4360-a12b-16621dc157ac None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:27.294931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a971-f9e8-4360-a12b-16621dc157ac None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:27.296247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 593/1186] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:39:27.302001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf1f23-afae-4a72-a1d2-f97af7734e96 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:27.302626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf1f23-afae-4a72-a1d2-f97af7734e96 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:27.302626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf1f23-afae-4a72-a1d2-f97af7734e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:27.323995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-64bf1f23-afae-4a72-a1d2-f97af7734e96 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:39:27.325263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-64bf1f23-afae-4a72-a1d2-f97af7734e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:39:27.339081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:27.399371 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 594/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:39:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:39:27.671923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a971-f9e8-4360-a12b-16621dc157ac None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:27.789716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a971-f9e8-4360-a12b-16621dc157ac None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:27.826454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5e659-75ab-4ba9-85f0-2296c210caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:27.827097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5e659-75ab-4ba9-85f0-2296c210caa8 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:27.827370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5e659-75ab-4ba9-85f0-2296c210caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:27.827647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5e659-75ab-4ba9-85f0-2296c210caa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:27.838702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5e659-75ab-4ba9-85f0-2296c210caa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-58a5e659-75ab-4ba9-85f0-2296c210caa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:39:27.843448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:39:27.844699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:39:27.845764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 594/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:39:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:39:27.850835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf1f23-afae-4a72-a1d2-f97af7734e96 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:27.960971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf1f23-afae-4a72-a1d2-f97af7734e96 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:27.995953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddda27d-e9e0-41e6-aef2-61394df9119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:27.996994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddda27d-e9e0-41e6-aef2-61394df9119d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:27.996994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddda27d-e9e0-41e6-aef2-61394df9119d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:27.997222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddda27d-e9e0-41e6-aef2-61394df9119d None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:27.997792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddda27d-e9e0-41e6-aef2-61394df9119d None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:27.998092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddda27d-e9e0-41e6-aef2-61394df9119d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:27.999448 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddda27d-e9e0-41e6-aef2-61394df9119d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:28.008600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 595/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:39:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:28.014679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5e659-75ab-4ba9-85f0-2296c210caa8 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:28.048725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:28.138617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5e659-75ab-4ba9-85f0-2296c210caa8 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:28.177058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9712e7-484f-412c-a69e-fb6052881a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:28.177695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9712e7-484f-412c-a69e-fb6052881a70 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:28.177964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9712e7-484f-412c-a69e-fb6052881a70 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:28.178234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9712e7-484f-412c-a69e-fb6052881a70 None admin] PATH_INFO: `/v3/users/ed304c124f834811b4e9b07f414b94a6` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:28.179497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9712e7-484f-412c-a69e-fb6052881a70 None admin] RBAC: Authorizing `identity:get_user(user_id=ed304c124f834811b4e9b07f414b94a6)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:28.181947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9712e7-484f-412c-a69e-fb6052881a70 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:28.185004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 595/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:39:28 2022] GET /identity/v3/users/ed304c124f834811b4e9b07f414b94a6 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:28.191664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddda27d-e9e0-41e6-aef2-61394df9119d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:28.206240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:28.313678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddda27d-e9e0-41e6-aef2-61394df9119d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:28.349631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bae0d-166d-49a4-bf6f-71e0f5d23c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:28.350183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bae0d-166d-49a4-bf6f-71e0f5d23c78 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:28.350461 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bae0d-166d-49a4-bf6f-71e0f5d23c78 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:28.350729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bae0d-166d-49a4-bf6f-71e0f5d23c78 None admin] PATH_INFO: `/v3/projects/8ffe4c8f1c3b4df582cc49773ed47262` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:28.351887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bae0d-166d-49a4-bf6f-71e0f5d23c78 None admin] RBAC: Authorizing `identity:get_project(project_id=8ffe4c8f1c3b4df582cc49773ed47262)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:28.353370 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bae0d-166d-49a4-bf6f-71e0f5d23c78 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:28.355024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 596/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:39:28 2022] GET /identity/v3/projects/8ffe4c8f1c3b4df582cc49773ed47262 => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:28.361147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9712e7-484f-412c-a69e-fb6052881a70 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:28.451356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:28.463104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9712e7-484f-412c-a69e-fb6052881a70 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:28.498573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6689bf-87b4-40fb-b7ec-10a29b14b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:28.499238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6689bf-87b4-40fb-b7ec-10a29b14b5ff None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:28.499520 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6689bf-87b4-40fb-b7ec-10a29b14b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:28.499793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6689bf-87b4-40fb-b7ec-10a29b14b5ff None admin] PATH_INFO: `/v3/projects/8ffe4c8f1c3b4df582cc49773ed47262/users/ed304c124f834811b4e9b07f414b94a6/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:28.501736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6689bf-87b4-40fb-b7ec-10a29b14b5ff None admin] RBAC: Authorizing `identity:create_grant(project_id=8ffe4c8f1c3b4df582cc49773ed47262, user_id=ed304c124f834811b4e9b07f414b94a6, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:28.503207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6689bf-87b4-40fb-b7ec-10a29b14b5ff None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:28.605316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 596/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:39:28 2022] PUT /identity/v3/projects/8ffe4c8f1c3b4df582cc49773ed47262/users/ed304c124f834811b4e9b07f414b94a6/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:39:30.592844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb16671-d0c8-4314-8f17-43891fc6865d None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:30.593389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb16671-d0c8-4314-8f17-43891fc6865d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:30.593497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb16671-d0c8-4314-8f17-43891fc6865d None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:30.594900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 597/1193] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:39:30.600533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d5aa8-9dc0-4504-a3c8-f0d24006f0ae None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:30.600967 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d5aa8-9dc0-4504-a3c8-f0d24006f0ae None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:30.601067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d5aa8-9dc0-4504-a3c8-f0d24006f0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:30.619208 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-507d5aa8-9dc0-4504-a3c8-f0d24006f0ae None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:39:30.620406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-507d5aa8-9dc0-4504-a3c8-f0d24006f0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:39:30.698248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 597/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:39:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:39:30.965506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb16671-d0c8-4314-8f17-43891fc6865d None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:31.053791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:31.082468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb16671-d0c8-4314-8f17-43891fc6865d None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:31.119179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec265-f29e-4bbc-91d0-a624cdc94a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:31.119803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec265-f29e-4bbc-91d0-a624cdc94a7a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:31.120078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec265-f29e-4bbc-91d0-a624cdc94a7a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:31.120345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec265-f29e-4bbc-91d0-a624cdc94a7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:31.131405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cec265-f29e-4bbc-91d0-a624cdc94a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-69cec265-f29e-4bbc-91d0-a624cdc94a7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:39:31.136188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:39:31.137419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:39:31.138712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 598/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:39:31.143584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d5aa8-9dc0-4504-a3c8-f0d24006f0ae None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:31.226856 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:31.251205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d5aa8-9dc0-4504-a3c8-f0d24006f0ae None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:31.288640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aa526-6c77-445c-b9c3-7b119cb44da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:31.289579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aa526-6c77-445c-b9c3-7b119cb44da2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:31.290386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aa526-6c77-445c-b9c3-7b119cb44da2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:31.290931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aa526-6c77-445c-b9c3-7b119cb44da2 None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:31.291644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aa526-6c77-445c-b9c3-7b119cb44da2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:31.291959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aa526-6c77-445c-b9c3-7b119cb44da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:31.293421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aa526-6c77-445c-b9c3-7b119cb44da2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:31.303600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 598/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:31.310247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec265-f29e-4bbc-91d0-a624cdc94a7a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:31.422125 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec265-f29e-4bbc-91d0-a624cdc94a7a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:31.456772 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9f10-f87a-41e1-811f-945c30c4d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:31.457407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9f10-f87a-41e1-811f-945c30c4d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:31.457689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9f10-f87a-41e1-811f-945c30c4d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:31.457962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca9f10-f87a-41e1-811f-945c30c4d7d3 None admin] PATH_INFO: `/v3/users/ed304c124f834811b4e9b07f414b94a6` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:31.459163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca9f10-f87a-41e1-811f-945c30c4d7d3 None admin] RBAC: Authorizing `identity:get_user(user_id=ed304c124f834811b4e9b07f414b94a6)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:31.460629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca9f10-f87a-41e1-811f-945c30c4d7d3 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:31.462368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 599/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 15:39:31 2022] GET /identity/v3/users/ed304c124f834811b4e9b07f414b94a6 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:31.468647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aa526-6c77-445c-b9c3-7b119cb44da2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:31.573785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aa526-6c77-445c-b9c3-7b119cb44da2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:31.608652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330991b-cc84-46e1-a30c-a6c8534aec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:31.609295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330991b-cc84-46e1-a30c-a6c8534aec7f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:31.609526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330991b-cc84-46e1-a30c-a6c8534aec7f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:31.609792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330991b-cc84-46e1-a30c-a6c8534aec7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:31.621716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:31.682617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330991b-cc84-46e1-a30c-a6c8534aec7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:31.684069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330991b-cc84-46e1-a30c-a6c8534aec7f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:31.794168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 599/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:39:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:39:31.800809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9f10-f87a-41e1-811f-945c30c4d7d3 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:31.804824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:31.947252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca9f10-f87a-41e1-811f-945c30c4d7d3 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:32.001633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c95e31-4d68-45ef-9b1e-9eb85680bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:32.002335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95e31-4d68-45ef-9b1e-9eb85680bfec None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:32.003183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95e31-4d68-45ef-9b1e-9eb85680bfec None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:32.003495 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95e31-4d68-45ef-9b1e-9eb85680bfec None admin] PATH_INFO: `/v3/projects/8ffe4c8f1c3b4df582cc49773ed47262` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:32.005006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c95e31-4d68-45ef-9b1e-9eb85680bfec None admin] RBAC: Authorizing `identity:get_project(project_id=8ffe4c8f1c3b4df582cc49773ed47262)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:32.006522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c95e31-4d68-45ef-9b1e-9eb85680bfec None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:32.008298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 600/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 15:39:31 2022] GET /identity/v3/projects/8ffe4c8f1c3b4df582cc49773ed47262 => generated 361 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:32.015941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330991b-cc84-46e1-a30c-a6c8534aec7f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:39:32.062807 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:32.130894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330991b-cc84-46e1-a30c-a6c8534aec7f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:39:32.168006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e34c17-c76b-40f7-8b34-372d1a3ea4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:39:32.168654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e34c17-c76b-40f7-8b34-372d1a3ea4bf None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:39:32.168938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e34c17-c76b-40f7-8b34-372d1a3ea4bf None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:39:32.169214 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e34c17-c76b-40f7-8b34-372d1a3ea4bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:39:32.169960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e34c17-c76b-40f7-8b34-372d1a3ea4bf None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=8ffe4c8f1c3b4df582cc49773ed47262, user.id=ed304c124f834811b4e9b07f414b94a6) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:39:32.170273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e34c17-c76b-40f7-8b34-372d1a3ea4bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:39:32.171744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e34c17-c76b-40f7-8b34-372d1a3ea4bf None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:39:32.178569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 600/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:39:32 2022] GET /identity/v3/role_assignments?user.id=ed304c124f834811b4e9b07f414b94a6&scope.project.id=8ffe4c8f1c3b4df582cc49773ed47262&role.id=eeb6551eeb934053866fc821b511b5dd => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:39:41.996968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=64 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:39:42.175620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=48 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:51.090035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13640571-3aa2-416f-a8a2-d29abb76779e None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:51.090629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13640571-3aa2-416f-a8a2-d29abb76779e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:51.090629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13640571-3aa2-416f-a8a2-d29abb76779e None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:51.092556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 601/1201] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:40:51.098257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270311e2-93da-43ec-ba24-39c1824b87b1 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:51.098839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270311e2-93da-43ec-ba24-39c1824b87b1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:51.098839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270311e2-93da-43ec-ba24-39c1824b87b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:51.118091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-270311e2-93da-43ec-ba24-39c1824b87b1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:40:51.119396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-270311e2-93da-43ec-ba24-39c1824b87b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:40:51.194454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 601/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:40:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:40:51.479779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13640571-3aa2-416f-a8a2-d29abb76779e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:51.605444 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13640571-3aa2-416f-a8a2-d29abb76779e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:51.643120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b82e5d-4357-43ad-a574-36a1932a92af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:51.643766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b82e5d-4357-43ad-a574-36a1932a92af None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:51.644046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b82e5d-4357-43ad-a574-36a1932a92af None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:51.644314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b82e5d-4357-43ad-a574-36a1932a92af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:51.656042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b82e5d-4357-43ad-a574-36a1932a92af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:51.662079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b82e5d-4357-43ad-a574-36a1932a92af None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-48b82e5d-4357-43ad-a574-36a1932a92af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:40:51.674982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:40:51.676367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:40:51.679410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:40:51.679410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:40:51.679410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:40:51.679410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 602/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:40:51.683220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270311e2-93da-43ec-ba24-39c1824b87b1 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:51.798778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270311e2-93da-43ec-ba24-39c1824b87b1 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:51.832902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:51.839824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cbc41-d03f-40b4-9e11-e7b5f3451d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:51.840468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cbc41-d03f-40b4-9e11-e7b5f3451d3f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:51.840776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cbc41-d03f-40b4-9e11-e7b5f3451d3f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:51.841048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cbc41-d03f-40b4-9e11-e7b5f3451d3f None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:51.841697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cbc41-d03f-40b4-9e11-e7b5f3451d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:40:51.842001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cbc41-d03f-40b4-9e11-e7b5f3451d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:51.843376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cbc41-d03f-40b4-9e11-e7b5f3451d3f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:51.855500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 602/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:40:51.862022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b82e5d-4357-43ad-a574-36a1932a92af None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:51.926508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:51.980249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b82e5d-4357-43ad-a574-36a1932a92af None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:52.018040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea363c2-f6a8-49e9-b491-e988d7c4dd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:52.018691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea363c2-f6a8-49e9-b491-e988d7c4dd30 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:52.018967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea363c2-f6a8-49e9-b491-e988d7c4dd30 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:52.019299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea363c2-f6a8-49e9-b491-e988d7c4dd30 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:52.020019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea363c2-f6a8-49e9-b491-e988d7c4dd30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:52.021545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea363c2-f6a8-49e9-b491-e988d7c4dd30 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:52.138929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 603/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 15:40:51 2022] POST /identity/v3/users => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:40:54.153254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5f4a-2507-4420-8ac3-74c421d145a4 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:54.153813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5f4a-2507-4420-8ac3-74c421d145a4 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:54.153918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5f4a-2507-4420-8ac3-74c421d145a4 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:54.155746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 603/1206] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:40:54.161507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ec127-e75c-46d0-9ca7-6beb2af92d7d None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:54.162163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ec127-e75c-46d0-9ca7-6beb2af92d7d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:54.162163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ec127-e75c-46d0-9ca7-6beb2af92d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:54.183123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c10ec127-e75c-46d0-9ca7-6beb2af92d7d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:40:54.184934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c10ec127-e75c-46d0-9ca7-6beb2af92d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:40:54.269343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 604/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:40:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:40:54.540035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5f4a-2507-4420-8ac3-74c421d145a4 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:54.652528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5f4a-2507-4420-8ac3-74c421d145a4 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:54.689625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559d873-5e44-41a3-895d-a59a532eb833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:54.690366 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d873-5e44-41a3-895d-a59a532eb833 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:54.690556 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d873-5e44-41a3-895d-a59a532eb833 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:54.691356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d873-5e44-41a3-895d-a59a532eb833 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:54.703041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559d873-5e44-41a3-895d-a59a532eb833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-6559d873-5e44-41a3-895d-a59a532eb833 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:40:54.707876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:40:54.709056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:40:54.709935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 604/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:40:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:40:54.715184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ec127-e75c-46d0-9ca7-6beb2af92d7d None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:54.758281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:54.824573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ec127-e75c-46d0-9ca7-6beb2af92d7d None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:54.865572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64005b2a-e7af-49fd-b6c9-53310887769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:54.866191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64005b2a-e7af-49fd-b6c9-53310887769a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:54.866468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64005b2a-e7af-49fd-b6c9-53310887769a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:54.866739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64005b2a-e7af-49fd-b6c9-53310887769a None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:54.867459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64005b2a-e7af-49fd-b6c9-53310887769a None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:40:54.867792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64005b2a-e7af-49fd-b6c9-53310887769a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:54.869196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64005b2a-e7af-49fd-b6c9-53310887769a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:54.878010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 605/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:40:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:40:54.883890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559d873-5e44-41a3-895d-a59a532eb833 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:54.946197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:55.017137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559d873-5e44-41a3-895d-a59a532eb833 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:55.057833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907df6f-40ab-4095-b297-1b7b882f6867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:55.058663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907df6f-40ab-4095-b297-1b7b882f6867 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:55.059053 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907df6f-40ab-4095-b297-1b7b882f6867 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:55.059404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907df6f-40ab-4095-b297-1b7b882f6867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:55.071981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907df6f-40ab-4095-b297-1b7b882f6867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:55.073544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907df6f-40ab-4095-b297-1b7b882f6867 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-5907df6f-40ab-4095-b297-1b7b882f6867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:40:55.093269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:40:55.094899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:40:55.096064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:40:55.096064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:40:55.096064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:40:55.096064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 605/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:40:55.099358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64005b2a-e7af-49fd-b6c9-53310887769a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:55.212694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:55.216252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64005b2a-e7af-49fd-b6c9-53310887769a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:55.254181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45233-8038-4439-b92a-8d6122a3ff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:55.254804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45233-8038-4439-b92a-8d6122a3ff2f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:55.255087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45233-8038-4439-b92a-8d6122a3ff2f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:55.255362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f45233-8038-4439-b92a-8d6122a3ff2f None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:55.256008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45233-8038-4439-b92a-8d6122a3ff2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:40:55.256322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45233-8038-4439-b92a-8d6122a3ff2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:55.257732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f45233-8038-4439-b92a-8d6122a3ff2f None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:55.269832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 606/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:40:55.275198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907df6f-40ab-4095-b297-1b7b882f6867 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:55.392610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907df6f-40ab-4095-b297-1b7b882f6867 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:55.394213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:55.429794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6bb50-d68a-4ffa-a437-8e8b3246fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:55.430428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6bb50-d68a-4ffa-a437-8e8b3246fe24 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:55.430703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6bb50-d68a-4ffa-a437-8e8b3246fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:55.430973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6bb50-d68a-4ffa-a437-8e8b3246fe24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:55.439988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6bb50-d68a-4ffa-a437-8e8b3246fe24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:55.441596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6bb50-d68a-4ffa-a437-8e8b3246fe24 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-4ca6bb50-d68a-4ffa-a437-8e8b3246fe24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:40:55.453527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:40:55.454708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:40:55.455680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 606/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:40:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:40:55.460625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45233-8038-4439-b92a-8d6122a3ff2f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:55.570295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f45233-8038-4439-b92a-8d6122a3ff2f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:55.615374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399d64-c173-49f3-a781-373126c55f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:55.620321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399d64-c173-49f3-a781-373126c55f4d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:55.620321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399d64-c173-49f3-a781-373126c55f4d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:55.620321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399d64-c173-49f3-a781-373126c55f4d None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:55.620321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78399d64-c173-49f3-a781-373126c55f4d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:40:55.620321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78399d64-c173-49f3-a781-373126c55f4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:55.620321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78399d64-c173-49f3-a781-373126c55f4d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:55.643757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 607/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 15:40:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:40:55.650174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6bb50-d68a-4ffa-a437-8e8b3246fe24 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:55.760184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6bb50-d68a-4ffa-a437-8e8b3246fe24 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:55.806536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f6133-8a97-4819-9f6b-4bf1b3c242b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:55.807155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6133-8a97-4819-9f6b-4bf1b3c242b2 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:55.807433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6133-8a97-4819-9f6b-4bf1b3c242b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:55.807707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f6133-8a97-4819-9f6b-4bf1b3c242b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:55.839475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:55.881767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f6133-8a97-4819-9f6b-4bf1b3c242b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:55.883234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f6133-8a97-4819-9f6b-4bf1b3c242b2 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:55.991603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 607/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:40:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:40:55.997760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399d64-c173-49f3-a781-373126c55f4d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:56.018792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:56.102120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399d64-c173-49f3-a781-373126c55f4d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:56.146501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8ff24-84c1-4eee-9c79-444c072b2ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:56.147144 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8ff24-84c1-4eee-9c79-444c072b2ec2 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:56.147424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8ff24-84c1-4eee-9c79-444c072b2ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:56.147751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8ff24-84c1-4eee-9c79-444c072b2ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:56.159359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8ff24-84c1-4eee-9c79-444c072b2ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:56.160882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8ff24-84c1-4eee-9c79-444c072b2ec2 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-66d8ff24-84c1-4eee-9c79-444c072b2ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:40:56.176067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:40:56.177439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:40:56.178607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:40:56.178607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:40:56.178607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:40:56.178607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 608/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:40:56.183349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f6133-8a97-4819-9f6b-4bf1b3c242b2 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:56.251184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:56.294499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f6133-8a97-4819-9f6b-4bf1b3c242b2 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:56.331155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb0e85-08d2-40b7-ac8c-91b54d079b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:56.331754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0e85-08d2-40b7-ac8c-91b54d079b81 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:56.332064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0e85-08d2-40b7-ac8c-91b54d079b81 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:56.332350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0e85-08d2-40b7-ac8c-91b54d079b81 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:56.333034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb0e85-08d2-40b7-ac8c-91b54d079b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:40:56.333494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb0e85-08d2-40b7-ac8c-91b54d079b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:56.334862 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb0e85-08d2-40b7-ac8c-91b54d079b81 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:56.346654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 608/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:40:56.352874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8ff24-84c1-4eee-9c79-444c072b2ec2 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:56.427378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:56.459583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8ff24-84c1-4eee-9c79-444c072b2ec2 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:56.495702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f4e5e-9eb8-4b62-ab55-935da8b475d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:56.496440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f4e5e-9eb8-4b62-ab55-935da8b475d1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:56.496751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f4e5e-9eb8-4b62-ab55-935da8b475d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:56.497022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f4e5e-9eb8-4b62-ab55-935da8b475d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:56.505198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f4e5e-9eb8-4b62-ab55-935da8b475d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:56.506515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f4e5e-9eb8-4b62-ab55-935da8b475d1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-d46f4e5e-9eb8-4b62-ab55-935da8b475d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:40:56.520189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:40:56.521445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:40:56.522666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:40:56.522666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:40:56.522666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:40:56.522666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:40:56.522666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:40:56.522666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:40:56.522666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:40:56.522666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:40:56.522666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 609/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:40:56.527702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb0e85-08d2-40b7-ac8c-91b54d079b81 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:56.640072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb0e85-08d2-40b7-ac8c-91b54d079b81 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:56.665858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:56.678793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec98d0d-54d9-491e-b608-4eac873f42a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:56.679458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec98d0d-54d9-491e-b608-4eac873f42a7 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:56.679734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec98d0d-54d9-491e-b608-4eac873f42a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:56.680004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec98d0d-54d9-491e-b608-4eac873f42a7 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:56.680739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec98d0d-54d9-491e-b608-4eac873f42a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:40:56.681047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec98d0d-54d9-491e-b608-4eac873f42a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:56.682532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec98d0d-54d9-491e-b608-4eac873f42a7 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:56.696297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 609/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:40:56.702889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f4e5e-9eb8-4b62-ab55-935da8b475d1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:56.815009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f4e5e-9eb8-4b62-ab55-935da8b475d1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:56.845010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:56.851081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323100be-94da-4b49-b9e9-2b1116554fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:56.851709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323100be-94da-4b49-b9e9-2b1116554fe1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:56.852020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323100be-94da-4b49-b9e9-2b1116554fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:56.852294 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323100be-94da-4b49-b9e9-2b1116554fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:56.853070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323100be-94da-4b49-b9e9-2b1116554fe1 None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=9ecb4e7e9e3042adadd93229f8456eca) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:40:56.853383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323100be-94da-4b49-b9e9-2b1116554fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:56.854936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323100be-94da-4b49-b9e9-2b1116554fe1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:56.861198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 610/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:40:56 2022] GET /identity/v3/role_assignments?user.id=9ecb4e7e9e3042adadd93229f8456eca&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:40:58.837449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5838e-73c8-4155-9465-8e0dc59e4b26 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:58.838021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5838e-73c8-4155-9465-8e0dc59e4b26 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:58.838021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5838e-73c8-4155-9465-8e0dc59e4b26 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:58.839381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 610/1220] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:40:58.845809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8431a2-4802-474f-84c2-cf27f3bcd67c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:58.846324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8431a2-4802-474f-84c2-cf27f3bcd67c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:58.846438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8431a2-4802-474f-84c2-cf27f3bcd67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:58.866907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0f8431a2-4802-474f-84c2-cf27f3bcd67c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:40:58.873077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0f8431a2-4802-474f-84c2-cf27f3bcd67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:40:58.947955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 611/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:40:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:40:59.224202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5838e-73c8-4155-9465-8e0dc59e4b26 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:59.339862 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5838e-73c8-4155-9465-8e0dc59e4b26 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:59.376802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec81d2-1760-46ec-8ad1-252539c66465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:59.377425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec81d2-1760-46ec-8ad1-252539c66465 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:59.377695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec81d2-1760-46ec-8ad1-252539c66465 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:59.377964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec81d2-1760-46ec-8ad1-252539c66465 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:59.388994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec81d2-1760-46ec-8ad1-252539c66465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-13ec81d2-1760-46ec-8ad1-252539c66465 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:40:59.393849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:40:59.396577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:40:59.397727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 611/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:40:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:40:59.401129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8431a2-4802-474f-84c2-cf27f3bcd67c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:59.502161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8431a2-4802-474f-84c2-cf27f3bcd67c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:59.527773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:59.538771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c5ee5-4fd8-4fb2-9876-13f597e92b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:59.539393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5ee5-4fd8-4fb2-9876-13f597e92b24 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:59.539673 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5ee5-4fd8-4fb2-9876-13f597e92b24 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:59.539943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5ee5-4fd8-4fb2-9876-13f597e92b24 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:59.540695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5ee5-4fd8-4fb2-9876-13f597e92b24 None admin] RBAC: Adding query filter params (name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:40:59.541000 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5ee5-4fd8-4fb2-9876-13f597e92b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:59.542457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5ee5-4fd8-4fb2-9876-13f597e92b24 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:59.551924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 612/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:40:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:40:59.558376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec81d2-1760-46ec-8ad1-252539c66465 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:59.614728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:40:59.674285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec81d2-1760-46ec-8ad1-252539c66465 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:59.711075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283dd46-742a-4301-8c62-c25a5d7b8f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:59.711704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283dd46-742a-4301-8c62-c25a5d7b8f37 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:59.711976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283dd46-742a-4301-8c62-c25a5d7b8f37 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:59.712245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283dd46-742a-4301-8c62-c25a5d7b8f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:59.723249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283dd46-742a-4301-8c62-c25a5d7b8f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:59.724744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283dd46-742a-4301-8c62-c25a5d7b8f37 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-0283dd46-742a-4301-8c62-c25a5d7b8f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:40:59.740696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:40:59.742423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:40:59.743607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:40:59.743607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:40:59.743607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:40:59.743607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 612/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:40:59.749635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c5ee5-4fd8-4fb2-9876-13f597e92b24 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:40:59.864259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c5ee5-4fd8-4fb2-9876-13f597e92b24 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:40:59.899912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31493827-778f-4f86-a535-1ea7a7a14f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:40:59.900539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493827-778f-4f86-a535-1ea7a7a14f67 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:40:59.900836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493827-778f-4f86-a535-1ea7a7a14f67 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:40:59.901112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493827-778f-4f86-a535-1ea7a7a14f67 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:40:59.901753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31493827-778f-4f86-a535-1ea7a7a14f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:40:59.902098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31493827-778f-4f86-a535-1ea7a7a14f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:40:59.903464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31493827-778f-4f86-a535-1ea7a7a14f67 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:40:59.915187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 613/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:40:59.921616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283dd46-742a-4301-8c62-c25a5d7b8f37 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:00.034003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:00.040906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283dd46-742a-4301-8c62-c25a5d7b8f37 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:00.076506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db565447-788c-448b-a817-4df1ba78afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:00.077168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db565447-788c-448b-a817-4df1ba78afc5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:00.077449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db565447-788c-448b-a817-4df1ba78afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:00.077715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db565447-788c-448b-a817-4df1ba78afc5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:00.089464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db565447-788c-448b-a817-4df1ba78afc5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:00.092598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db565447-788c-448b-a817-4df1ba78afc5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-db565447-788c-448b-a817-4df1ba78afc5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:41:00.104525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:00.105713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:00.107514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 613/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:40:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:00.112700 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31493827-778f-4f86-a535-1ea7a7a14f67 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:00.163284 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:00.220649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31493827-778f-4f86-a535-1ea7a7a14f67 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:00.262839 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355968c-e95d-4daf-98b3-461b5454bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:00.263499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355968c-e95d-4daf-98b3-461b5454bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:00.263773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355968c-e95d-4daf-98b3-461b5454bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:00.264041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355968c-e95d-4daf-98b3-461b5454bfc9 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:00.264805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355968c-e95d-4daf-98b3-461b5454bfc9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:00.265114 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355968c-e95d-4daf-98b3-461b5454bfc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:00.266547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355968c-e95d-4daf-98b3-461b5454bfc9 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:00.285819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 614/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 15:41:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:00.293622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db565447-788c-448b-a817-4df1ba78afc5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:00.406407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db565447-788c-448b-a817-4df1ba78afc5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:00.443191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d146e-bae0-4536-b2f6-f7b57a5265d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:00.443818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d146e-bae0-4536-b2f6-f7b57a5265d6 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:00.444093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d146e-bae0-4536-b2f6-f7b57a5265d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:00.444362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d146e-bae0-4536-b2f6-f7b57a5265d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:00.455617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d146e-bae0-4536-b2f6-f7b57a5265d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:00.457295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d146e-bae0-4536-b2f6-f7b57a5265d6 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-d13d146e-bae0-4536-b2f6-f7b57a5265d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:41:00.471275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:00.472662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:41:00.473818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:41:00.473818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:00.473818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:00.473818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 614/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:00.478445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355968c-e95d-4daf-98b3-461b5454bfc9 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:00.594355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355968c-e95d-4daf-98b3-461b5454bfc9 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:00.596870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:00.630551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e531-6f79-44bb-ad50-f099a2a711ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:00.631186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e531-6f79-44bb-ad50-f099a2a711ec None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:00.631507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e531-6f79-44bb-ad50-f099a2a711ec None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:00.631904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e531-6f79-44bb-ad50-f099a2a711ec None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:00.632591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5e531-6f79-44bb-ad50-f099a2a711ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:00.632901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5e531-6f79-44bb-ad50-f099a2a711ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:00.634544 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5e531-6f79-44bb-ad50-f099a2a711ec None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:00.650250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 615/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:00.656815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d146e-bae0-4536-b2f6-f7b57a5265d6 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:00.666792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:00.767007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d146e-bae0-4536-b2f6-f7b57a5265d6 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:00.801792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335366f-43a2-47c1-9c77-0c73143e66c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:00.802460 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335366f-43a2-47c1-9c77-0c73143e66c5 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:00.802774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335366f-43a2-47c1-9c77-0c73143e66c5 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:00.803047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335366f-43a2-47c1-9c77-0c73143e66c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:00.810654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335366f-43a2-47c1-9c77-0c73143e66c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:00.812100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335366f-43a2-47c1-9c77-0c73143e66c5 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-d335366f-43a2-47c1-9c77-0c73143e66c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:41:00.824037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:00.825236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:00.826787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:41:00.826787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:41:00.826787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:41:00.826787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:41:00.826787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:41:00.826787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:41:00.826787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:41:00.826787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:00.826787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 615/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:41:00.832181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e531-6f79-44bb-ad50-f099a2a711ec None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:00.939174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e531-6f79-44bb-ad50-f099a2a711ec None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:00.982299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a977083-2bfd-4982-9e03-9fcca59299bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:00.982913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a977083-2bfd-4982-9e03-9fcca59299bd None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:00.983192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a977083-2bfd-4982-9e03-9fcca59299bd None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:00.983463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a977083-2bfd-4982-9e03-9fcca59299bd None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:00.984160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a977083-2bfd-4982-9e03-9fcca59299bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:00.984653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a977083-2bfd-4982-9e03-9fcca59299bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:00.986158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a977083-2bfd-4982-9e03-9fcca59299bd None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:01.006227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 616/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:01.012924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335366f-43a2-47c1-9c77-0c73143e66c5 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:01.082094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:01.121959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335366f-43a2-47c1-9c77-0c73143e66c5 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:01.156841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5452f7-2b0c-4d52-9151-a69afee67c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:01.157533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5452f7-2b0c-4d52-9151-a69afee67c35 None admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:01.157810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5452f7-2b0c-4d52-9151-a69afee67c35 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:01.158091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5452f7-2b0c-4d52-9151-a69afee67c35 None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/9ecb4e7e9e3042adadd93229f8456eca/roles/3713b2e0c4f04c8cad78881a656528e6` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:01.173300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5452f7-2b0c-4d52-9151-a69afee67c35 None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=9ecb4e7e9e3042adadd93229f8456eca, role_id=3713b2e0c4f04c8cad78881a656528e6)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:01.174734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5452f7-2b0c-4d52-9151-a69afee67c35 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:01.315511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 616/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:41:01 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/9ecb4e7e9e3042adadd93229f8456eca/roles/3713b2e0c4f04c8cad78881a656528e6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:41:03.260905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a94ee4-47a2-4d55-98ce-b7c56f9d82fe None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:03.261477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a94ee4-47a2-4d55-98ce-b7c56f9d82fe None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:03.261590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a94ee4-47a2-4d55-98ce-b7c56f9d82fe None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:03.262908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 617/1233] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:41:03.269080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42614b8a-d5a6-4892-ad59-b828e105025e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:03.269559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42614b8a-d5a6-4892-ad59-b828e105025e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:03.269651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42614b8a-d5a6-4892-ad59-b828e105025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:03.287532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-42614b8a-d5a6-4892-ad59-b828e105025e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:41:03.288774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-42614b8a-d5a6-4892-ad59-b828e105025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:41:03.368981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 617/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:41:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:41:03.637025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a94ee4-47a2-4d55-98ce-b7c56f9d82fe None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:03.674216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:03.756348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a94ee4-47a2-4d55-98ce-b7c56f9d82fe None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:03.800565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e669991-96b2-4451-8f88-e351f88f3e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:03.801217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e669991-96b2-4451-8f88-e351f88f3e02 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:03.802091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e669991-96b2-4451-8f88-e351f88f3e02 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:03.802366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e669991-96b2-4451-8f88-e351f88f3e02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:03.813373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e669991-96b2-4451-8f88-e351f88f3e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-5e669991-96b2-4451-8f88-e351f88f3e02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:41:03.818343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:03.819512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:03.820383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 618/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 15:41:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:03.825865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42614b8a-d5a6-4892-ad59-b828e105025e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:03.876577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:03.935229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42614b8a-d5a6-4892-ad59-b828e105025e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:03.973776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda0ee-d3a4-4a45-bb68-30e7c916705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:03.974396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda0ee-d3a4-4a45-bb68-30e7c916705b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:03.974670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda0ee-d3a4-4a45-bb68-30e7c916705b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:03.974945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda0ee-d3a4-4a45-bb68-30e7c916705b None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:03.975651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbda0ee-d3a4-4a45-bb68-30e7c916705b None admin] RBAC: Adding query filter params (name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:03.975949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbda0ee-d3a4-4a45-bb68-30e7c916705b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:03.977405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbda0ee-d3a4-4a45-bb68-30e7c916705b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:03.988922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 618/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 15:41:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:03.994863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e669991-96b2-4451-8f88-e351f88f3e02 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:04.094120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:04.111229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e669991-96b2-4451-8f88-e351f88f3e02 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:04.152276 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83185219-4379-42de-9b50-152f9eecb15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:04.153054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185219-4379-42de-9b50-152f9eecb15e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:04.153463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185219-4379-42de-9b50-152f9eecb15e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:04.154257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83185219-4379-42de-9b50-152f9eecb15e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:04.166730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83185219-4379-42de-9b50-152f9eecb15e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:04.168387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83185219-4379-42de-9b50-152f9eecb15e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-83185219-4379-42de-9b50-152f9eecb15e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:41:04.191441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:04.192570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:41:04.193509 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:41:04.193509 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:04.193509 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:04.193509 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 619/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:04.197321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda0ee-d3a4-4a45-bb68-30e7c916705b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:04.305333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda0ee-d3a4-4a45-bb68-30e7c916705b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:04.315630 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:04.342433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc06c2-a0f6-46ac-a802-f8e1f71805c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:04.343042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc06c2-a0f6-46ac-a802-f8e1f71805c4 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:04.343341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc06c2-a0f6-46ac-a802-f8e1f71805c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:04.343619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc06c2-a0f6-46ac-a802-f8e1f71805c4 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:04.344263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc06c2-a0f6-46ac-a802-f8e1f71805c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:04.344594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc06c2-a0f6-46ac-a802-f8e1f71805c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:04.346029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc06c2-a0f6-46ac-a802-f8e1f71805c4 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:04.358681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 619/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:04.364764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83185219-4379-42de-9b50-152f9eecb15e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:04.471093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83185219-4379-42de-9b50-152f9eecb15e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:04.509547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30564-fbf5-4923-878c-08a73fc063d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:04.510190 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30564-fbf5-4923-878c-08a73fc063d6 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:04.510469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30564-fbf5-4923-878c-08a73fc063d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:04.510743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef30564-fbf5-4923-878c-08a73fc063d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:04.514318 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:04.519784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef30564-fbf5-4923-878c-08a73fc063d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:04.521274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef30564-fbf5-4923-878c-08a73fc063d6 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-aef30564-fbf5-4923-878c-08a73fc063d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:41:04.534419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:04.536055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:04.537312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 620/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:04.541934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc06c2-a0f6-46ac-a802-f8e1f71805c4 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:04.652536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc06c2-a0f6-46ac-a802-f8e1f71805c4 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:04.689660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28fb2b-eab0-4d4c-acff-9c61c3f521d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:04.690494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28fb2b-eab0-4d4c-acff-9c61c3f521d3 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:04.690766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28fb2b-eab0-4d4c-acff-9c61c3f521d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:04.691034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28fb2b-eab0-4d4c-acff-9c61c3f521d3 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:04.691769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28fb2b-eab0-4d4c-acff-9c61c3f521d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:04.692072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28fb2b-eab0-4d4c-acff-9c61c3f521d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:04.693539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28fb2b-eab0-4d4c-acff-9c61c3f521d3 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:04.714055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 620/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 15:41:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:04.720027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30564-fbf5-4923-878c-08a73fc063d6 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:04.849903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef30564-fbf5-4923-878c-08a73fc063d6 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:04.885044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8152d81-dd2f-467b-9545-1c77108e897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:04.885658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152d81-dd2f-467b-9545-1c77108e897e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:04.885934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152d81-dd2f-467b-9545-1c77108e897e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:04.886207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8152d81-dd2f-467b-9545-1c77108e897e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:04.952257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:04.958920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8152d81-dd2f-467b-9545-1c77108e897e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:04.960389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8152d81-dd2f-467b-9545-1c77108e897e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:05.068537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 621/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:41:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:41:05.074446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28fb2b-eab0-4d4c-acff-9c61c3f521d3 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:05.103450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:05.183443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28fb2b-eab0-4d4c-acff-9c61c3f521d3 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:05.218551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c8ee8-16c1-4fc4-a1c3-bb8d968231d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:05.219940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c8ee8-16c1-4fc4-a1c3-bb8d968231d1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:05.219940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c8ee8-16c1-4fc4-a1c3-bb8d968231d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:05.219940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c8ee8-16c1-4fc4-a1c3-bb8d968231d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:05.229814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c8ee8-16c1-4fc4-a1c3-bb8d968231d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:05.231266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c8ee8-16c1-4fc4-a1c3-bb8d968231d1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-4b2c8ee8-16c1-4fc4-a1c3-bb8d968231d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:41:05.248660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:05.249826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:41:05.250894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:41:05.250894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:05.250894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:05.250894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 621/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:05.255872 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8152d81-dd2f-467b-9545-1c77108e897e None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:05.357998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:05.366104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8152d81-dd2f-467b-9545-1c77108e897e None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:05.401460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda6967-760a-4ea7-9beb-3bfad3f780bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:05.402072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda6967-760a-4ea7-9beb-3bfad3f780bf None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:05.402348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda6967-760a-4ea7-9beb-3bfad3f780bf None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:05.402618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda6967-760a-4ea7-9beb-3bfad3f780bf None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:05.403254 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda6967-760a-4ea7-9beb-3bfad3f780bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:05.404118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda6967-760a-4ea7-9beb-3bfad3f780bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:05.405584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda6967-760a-4ea7-9beb-3bfad3f780bf None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:05.420752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 622/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:05.427051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c8ee8-16c1-4fc4-a1c3-bb8d968231d1 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:05.513535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:05.537516 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c8ee8-16c1-4fc4-a1c3-bb8d968231d1 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:05.579086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fd719-d4be-4a76-8ba0-b5ca09384e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:05.579994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fd719-d4be-4a76-8ba0-b5ca09384e12 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:05.579994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fd719-d4be-4a76-8ba0-b5ca09384e12 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:05.580239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fd719-d4be-4a76-8ba0-b5ca09384e12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:05.587636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fd719-d4be-4a76-8ba0-b5ca09384e12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:05.589188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fd719-d4be-4a76-8ba0-b5ca09384e12 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-1e2fd719-d4be-4a76-8ba0-b5ca09384e12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:41:05.602342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:05.603511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:05.609466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:41:05.609466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:41:05.609466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:41:05.609466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:41:05.609466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:41:05.609466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:41:05.609466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:41:05.609466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:05.609466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 622/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:05.610300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda6967-760a-4ea7-9beb-3bfad3f780bf None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:05.721530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda6967-760a-4ea7-9beb-3bfad3f780bf None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:05.759934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1e4ff-bbb3-4d01-a452-3cf8ea9a6f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:05.760587 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1e4ff-bbb3-4d01-a452-3cf8ea9a6f8e None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:05.760867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1e4ff-bbb3-4d01-a452-3cf8ea9a6f8e None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:05.761138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1e4ff-bbb3-4d01-a452-3cf8ea9a6f8e None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:05.761835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1e4ff-bbb3-4d01-a452-3cf8ea9a6f8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:05.762141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1e4ff-bbb3-4d01-a452-3cf8ea9a6f8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:05.764067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1e4ff-bbb3-4d01-a452-3cf8ea9a6f8e None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:05.779140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 623/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:41:05.785872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fd719-d4be-4a76-8ba0-b5ca09384e12 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:05.900631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fd719-d4be-4a76-8ba0-b5ca09384e12 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:05.939052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fead7-6d24-40ca-a019-fa678f5adf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:05.939668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fead7-6d24-40ca-a019-fa678f5adf13 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:05.939943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fead7-6d24-40ca-a019-fa678f5adf13 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:05.940212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fead7-6d24-40ca-a019-fa678f5adf13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:05.940983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fead7-6d24-40ca-a019-fa678f5adf13 None admin] RBAC: Adding query filter params (role.id=3713b2e0c4f04c8cad78881a656528e6, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=9ecb4e7e9e3042adadd93229f8456eca) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:05.941296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fead7-6d24-40ca-a019-fa678f5adf13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:05.942728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fead7-6d24-40ca-a019-fa678f5adf13 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:05.948922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 623/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:41:05 2022] GET /identity/v3/role_assignments?user.id=9ecb4e7e9e3042adadd93229f8456eca&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=3713b2e0c4f04c8cad78881a656528e6 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:07.956160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353b3e-b887-424a-95ca-6a3ece1a74d3 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:07.956766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353b3e-b887-424a-95ca-6a3ece1a74d3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:07.956766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59353b3e-b887-424a-95ca-6a3ece1a74d3 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:07.958088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 624/1247] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:41:07.963889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1e4c-ff2a-4228-9a2f-fc89a952f1d3 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:07.964453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1e4c-ff2a-4228-9a2f-fc89a952f1d3 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:07.964453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1e4c-ff2a-4228-9a2f-fc89a952f1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:07.970911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:07.983448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-bffc1e4c-ff2a-4228-9a2f-fc89a952f1d3 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:41:07.985242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bffc1e4c-ff2a-4228-9a2f-fc89a952f1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:41:08.053918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 624/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:41:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:41:08.330464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59353b3e-b887-424a-95ca-6a3ece1a74d3 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:08.350515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:08.438968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59353b3e-b887-424a-95ca-6a3ece1a74d3 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:08.473875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298c32-7dbe-453c-bc2f-ddd6c68fa14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:08.474558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298c32-7dbe-453c-bc2f-ddd6c68fa14b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:08.474836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298c32-7dbe-453c-bc2f-ddd6c68fa14b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:08.475108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298c32-7dbe-453c-bc2f-ddd6c68fa14b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:08.487657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7298c32-7dbe-453c-bc2f-ddd6c68fa14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-f7298c32-7dbe-453c-bc2f-ddd6c68fa14b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:41:08.492899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:08.493923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:08.495471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 625/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:08.501092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1e4c-ff2a-4228-9a2f-fc89a952f1d3 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:08.605155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1e4c-ff2a-4228-9a2f-fc89a952f1d3 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:08.638959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:08.640539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fa610-ee61-433a-9115-a1c1c26bc07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:08.641333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fa610-ee61-433a-9115-a1c1c26bc07f None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:08.641445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fa610-ee61-433a-9115-a1c1c26bc07f None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:08.641670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fa610-ee61-433a-9115-a1c1c26bc07f None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:08.642337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fa610-ee61-433a-9115-a1c1c26bc07f None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:08.642641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fa610-ee61-433a-9115-a1c1c26bc07f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:08.644000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fa610-ee61-433a-9115-a1c1c26bc07f None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:08.652287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 625/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:41:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:08.658843 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298c32-7dbe-453c-bc2f-ddd6c68fa14b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:08.740004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:08.766651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298c32-7dbe-453c-bc2f-ddd6c68fa14b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:08.803997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe0bb-11a1-46bc-ae43-d910f9be084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:08.804728 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe0bb-11a1-46bc-ae43-d910f9be084a None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:08.805009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe0bb-11a1-46bc-ae43-d910f9be084a None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:08.805323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe0bb-11a1-46bc-ae43-d910f9be084a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:08.816072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fe0bb-11a1-46bc-ae43-d910f9be084a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:08.817682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fe0bb-11a1-46bc-ae43-d910f9be084a None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-af2fe0bb-11a1-46bc-ae43-d910f9be084a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:41:08.835523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:08.836789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:41:08.837983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:41:08.837983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:08.837983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:08.837983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 626/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:08.843530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fa610-ee61-433a-9115-a1c1c26bc07f None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:08.970451 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fa610-ee61-433a-9115-a1c1c26bc07f None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:09.006658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fb7ad-9594-4517-aaee-bf7f9be8b12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:09.007269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fb7ad-9594-4517-aaee-bf7f9be8b12d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:09.007555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fb7ad-9594-4517-aaee-bf7f9be8b12d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:09.007966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fb7ad-9594-4517-aaee-bf7f9be8b12d None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:09.008624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fb7ad-9594-4517-aaee-bf7f9be8b12d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:09.008931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fb7ad-9594-4517-aaee-bf7f9be8b12d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:09.010405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fb7ad-9594-4517-aaee-bf7f9be8b12d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:09.024141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 626/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:09.036084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe0bb-11a1-46bc-ae43-d910f9be084a None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:09.143370 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe0bb-11a1-46bc-ae43-d910f9be084a None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:09.171627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:09.180329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe5069-aab2-4ae9-ab61-4fda6476f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:09.180997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe5069-aab2-4ae9-ab61-4fda6476f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:09.181275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe5069-aab2-4ae9-ab61-4fda6476f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:09.181544 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe5069-aab2-4ae9-ab61-4fda6476f1a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:09.189797 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe5069-aab2-4ae9-ab61-4fda6476f1a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:09.191260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe5069-aab2-4ae9-ab61-4fda6476f1a6 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-9ffe5069-aab2-4ae9-ab61-4fda6476f1a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:41:09.202813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:09.203987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:09.205454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 627/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:09.210132 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fb7ad-9594-4517-aaee-bf7f9be8b12d None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:09.270576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:09.317649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fb7ad-9594-4517-aaee-bf7f9be8b12d None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:09.353831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6f97a-757d-4c43-a84b-d1375ade1689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:09.354440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f97a-757d-4c43-a84b-d1375ade1689 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:09.354716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f97a-757d-4c43-a84b-d1375ade1689 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:09.354981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f97a-757d-4c43-a84b-d1375ade1689 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:09.355707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6f97a-757d-4c43-a84b-d1375ade1689 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:09.356007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6f97a-757d-4c43-a84b-d1375ade1689 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:09.358037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6f97a-757d-4c43-a84b-d1375ade1689 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:09.376332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 627/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 15:41:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:09.384393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe5069-aab2-4ae9-ab61-4fda6476f1a6 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:09.493999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe5069-aab2-4ae9-ab61-4fda6476f1a6 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:09.528601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445685e-7434-4836-9aa6-36cc46b15d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:09.529145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445685e-7434-4836-9aa6-36cc46b15d1d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:09.529423 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445685e-7434-4836-9aa6-36cc46b15d1d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:09.529690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445685e-7434-4836-9aa6-36cc46b15d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:09.588431 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:09.601187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445685e-7434-4836-9aa6-36cc46b15d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:09.602737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445685e-7434-4836-9aa6-36cc46b15d1d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:09.718268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 628/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:41:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:41:09.724534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6f97a-757d-4c43-a84b-d1375ade1689 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:09.833201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6f97a-757d-4c43-a84b-d1375ade1689 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:09.847993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:09.869730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b05ba-7560-4baa-a3de-d1c5e7f86b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:09.870362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b05ba-7560-4baa-a3de-d1c5e7f86b1d None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:09.870633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b05ba-7560-4baa-a3de-d1c5e7f86b1d None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:09.870902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b05ba-7560-4baa-a3de-d1c5e7f86b1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:09.881282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b05ba-7560-4baa-a3de-d1c5e7f86b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:09.889645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b05ba-7560-4baa-a3de-d1c5e7f86b1d None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9f9b05ba-7560-4baa-a3de-d1c5e7f86b1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:41:09.897389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:09.898489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:41:09.899620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:41:09.899620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:09.899620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:09.899620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 628/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:09.904926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445685e-7434-4836-9aa6-36cc46b15d1d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:10.001119 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:10.018308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445685e-7434-4836-9aa6-36cc46b15d1d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:10.054319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b97f3f-05fe-4ee3-b206-444ce7696b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:10.055062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97f3f-05fe-4ee3-b206-444ce7696b57 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:10.055191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97f3f-05fe-4ee3-b206-444ce7696b57 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:10.055441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b97f3f-05fe-4ee3-b206-444ce7696b57 None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:10.056113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b97f3f-05fe-4ee3-b206-444ce7696b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:10.056420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b97f3f-05fe-4ee3-b206-444ce7696b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:10.057803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b97f3f-05fe-4ee3-b206-444ce7696b57 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:10.071795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 629/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:10.077634 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b05ba-7560-4baa-a3de-d1c5e7f86b1d None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:10.190178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b05ba-7560-4baa-a3de-d1c5e7f86b1d None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:10.235701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb88461-be5b-45f2-b174-f75cff480000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:10.236336 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb88461-be5b-45f2-b174-f75cff480000 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:10.236651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb88461-be5b-45f2-b174-f75cff480000 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:10.236930 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb88461-be5b-45f2-b174-f75cff480000 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:10.244590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb88461-be5b-45f2-b174-f75cff480000 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:10.246138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb88461-be5b-45f2-b174-f75cff480000 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9fb88461-be5b-45f2-b174-f75cff480000 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:41:10.259067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:10.260298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:10.261276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:41:10.261276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:41:10.261276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:41:10.261276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:41:10.261276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:41:10.261276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:41:10.261276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:41:10.261276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:10.261276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 629/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:41:10.266573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b97f3f-05fe-4ee3-b206-444ce7696b57 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:10.376111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b97f3f-05fe-4ee3-b206-444ce7696b57 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:10.411940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4d8a2-819e-4330-b636-f31ba0cb01cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:10.412606 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4d8a2-819e-4330-b636-f31ba0cb01cc None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:10.412913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4d8a2-819e-4330-b636-f31ba0cb01cc None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:10.413187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4d8a2-819e-4330-b636-f31ba0cb01cc None admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:10.413876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4d8a2-819e-4330-b636-f31ba0cb01cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:10.414229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4d8a2-819e-4330-b636-f31ba0cb01cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:10.415725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4d8a2-819e-4330-b636-f31ba0cb01cc None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:10.430036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 630/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:41:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:10.437251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb88461-be5b-45f2-b174-f75cff480000 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:10.467077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:10.550712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb88461-be5b-45f2-b174-f75cff480000 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:10.592307 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa963e0e-e1c6-4b37-92a9-44a8e46fcf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:10.599841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa963e0e-e1c6-4b37-92a9-44a8e46fcf32 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:10.599841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa963e0e-e1c6-4b37-92a9-44a8e46fcf32 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:10.599841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa963e0e-e1c6-4b37-92a9-44a8e46fcf32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:10.599841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa963e0e-e1c6-4b37-92a9-44a8e46fcf32 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=9ecb4e7e9e3042adadd93229f8456eca) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:10.599841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa963e0e-e1c6-4b37-92a9-44a8e46fcf32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:10.599841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa963e0e-e1c6-4b37-92a9-44a8e46fcf32 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:10.601443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 630/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:41:10 2022] GET /identity/v3/role_assignments?user.id=9ecb4e7e9e3042adadd93229f8456eca&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=eeb6551eeb934053866fc821b511b5dd => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:41:12.512898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d3c1-8c25-4346-a1a2-dc01d98e8566 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:12.513446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d3c1-8c25-4346-a1a2-dc01d98e8566 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:12.513446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d3c1-8c25-4346-a1a2-dc01d98e8566 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:12.514791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 631/1261] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:41:12.520351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0583bd3-3664-413b-b55b-cbc4d503ebf5 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:12.520859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0583bd3-3664-413b-b55b-cbc4d503ebf5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:12.522862 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0583bd3-3664-413b-b55b-cbc4d503ebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:12.539910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c0583bd3-3664-413b-b55b-cbc4d503ebf5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:41:12.541164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c0583bd3-3664-413b-b55b-cbc4d503ebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:41:12.616420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 631/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:41:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:41:12.884715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61d3c1-8c25-4346-a1a2-dc01d98e8566 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:12.896984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:12.998443 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61d3c1-8c25-4346-a1a2-dc01d98e8566 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:13.034037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8c838-4d59-4603-b5a7-604198e3729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:13.034665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8c838-4d59-4603-b5a7-604198e3729f None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:13.034936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8c838-4d59-4603-b5a7-604198e3729f None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:13.035202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8c838-4d59-4603-b5a7-604198e3729f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:13.045876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8c838-4d59-4603-b5a7-604198e3729f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-eff8c838-4d59-4603-b5a7-604198e3729f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:41:13.050900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:13.052057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:13.053377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 632/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:41:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:13.058046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0583bd3-3664-413b-b55b-cbc4d503ebf5 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:13.077591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:13.164837 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0583bd3-3664-413b-b55b-cbc4d503ebf5 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:13.202034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0902f3-a134-4f5a-9e70-b2ec350d63ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:13.202824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0902f3-a134-4f5a-9e70-b2ec350d63ae None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:13.203194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0902f3-a134-4f5a-9e70-b2ec350d63ae None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:13.203583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0902f3-a134-4f5a-9e70-b2ec350d63ae None admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:13.211022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0902f3-a134-4f5a-9e70-b2ec350d63ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:13.211022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0902f3-a134-4f5a-9e70-b2ec350d63ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:13.211022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0902f3-a134-4f5a-9e70-b2ec350d63ae None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:13.214428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 632/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:13.220292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8c838-4d59-4603-b5a7-604198e3729f None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:13.290254 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:13.324613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8c838-4d59-4603-b5a7-604198e3729f None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:13.360078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0973a-8d82-404e-bfbd-53ecc922b90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:13.360755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0973a-8d82-404e-bfbd-53ecc922b90b None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:13.361033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0973a-8d82-404e-bfbd-53ecc922b90b None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:13.361361 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0973a-8d82-404e-bfbd-53ecc922b90b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:13.372911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0973a-8d82-404e-bfbd-53ecc922b90b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:13.374412 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0973a-8d82-404e-bfbd-53ecc922b90b None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-d1e0973a-8d82-404e-bfbd-53ecc922b90b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:41:13.389355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:13.390583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:41:13.391719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:41:13.391719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:13.391719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:13.391719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 633/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:13.396454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0902f3-a134-4f5a-9e70-b2ec350d63ae None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:13.486169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:13.505372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0902f3-a134-4f5a-9e70-b2ec350d63ae None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:13.539255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a02eae-a5b4-49cb-8873-556406ce5fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:13.540036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a02eae-a5b4-49cb-8873-556406ce5fbc None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:13.540231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a02eae-a5b4-49cb-8873-556406ce5fbc None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:13.540497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a02eae-a5b4-49cb-8873-556406ce5fbc None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:13.541181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a02eae-a5b4-49cb-8873-556406ce5fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:13.541490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a02eae-a5b4-49cb-8873-556406ce5fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:13.542853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a02eae-a5b4-49cb-8873-556406ce5fbc None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:13.556199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 633/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:13.562114 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0973a-8d82-404e-bfbd-53ecc922b90b None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:13.674161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0973a-8d82-404e-bfbd-53ecc922b90b None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:13.695557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:13.711427 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777359-6e32-490c-8749-a10fb3e61907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:13.712067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777359-6e32-490c-8749-a10fb3e61907 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:13.712345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777359-6e32-490c-8749-a10fb3e61907 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:13.712649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd777359-6e32-490c-8749-a10fb3e61907 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:13.721741 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd777359-6e32-490c-8749-a10fb3e61907 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:13.723193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd777359-6e32-490c-8749-a10fb3e61907 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-dd777359-6e32-490c-8749-a10fb3e61907 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:41:13.735416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:13.736973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:13.738171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 634/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:13.742621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a02eae-a5b4-49cb-8873-556406ce5fbc None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:13.849149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a02eae-a5b4-49cb-8873-556406ce5fbc None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:13.885985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cec78d-802c-4bb2-a143-41ddfce1f3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:13.886594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cec78d-802c-4bb2-a143-41ddfce1f3a8 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:13.886890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cec78d-802c-4bb2-a143-41ddfce1f3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:13.887820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cec78d-802c-4bb2-a143-41ddfce1f3a8 None admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:13.888595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cec78d-802c-4bb2-a143-41ddfce1f3a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:13.888904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cec78d-802c-4bb2-a143-41ddfce1f3a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:13.890392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cec78d-802c-4bb2-a143-41ddfce1f3a8 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:13.900084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:13.910707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 634/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 15:41:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:13.916592 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777359-6e32-490c-8749-a10fb3e61907 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:14.036343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd777359-6e32-490c-8749-a10fb3e61907 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:14.072700 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14bb27-1297-4b46-8c8e-1a165961560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:14.073372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14bb27-1297-4b46-8c8e-1a165961560d None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:14.073684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14bb27-1297-4b46-8c8e-1a165961560d None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:14.073922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14bb27-1297-4b46-8c8e-1a165961560d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:14.085628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14bb27-1297-4b46-8c8e-1a165961560d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:14.087081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14bb27-1297-4b46-8c8e-1a165961560d None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-8f14bb27-1297-4b46-8c8e-1a165961560d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:41:14.102161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:14.103406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:41:14.104577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:41:14.104577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:14.104577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:14.104577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 635/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:14.109771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cec78d-802c-4bb2-a143-41ddfce1f3a8 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:14.216815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cec78d-802c-4bb2-a143-41ddfce1f3a8 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:14.252000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3014dcf-ef57-4d94-9059-d59bafb69134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:14.252654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3014dcf-ef57-4d94-9059-d59bafb69134 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:14.253093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3014dcf-ef57-4d94-9059-d59bafb69134 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:14.253381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3014dcf-ef57-4d94-9059-d59bafb69134 None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:14.254062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3014dcf-ef57-4d94-9059-d59bafb69134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:14.254372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3014dcf-ef57-4d94-9059-d59bafb69134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:14.255764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3014dcf-ef57-4d94-9059-d59bafb69134 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:14.268088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 635/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:14.274173 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14bb27-1297-4b46-8c8e-1a165961560d None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:14.307689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:14.381428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14bb27-1297-4b46-8c8e-1a165961560d None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:14.416642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3f5b3-c614-46dc-9a24-f7a83043cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:14.417289 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f5b3-c614-46dc-9a24-f7a83043cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:14.417575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f5b3-c614-46dc-9a24-f7a83043cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:14.417831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f5b3-c614-46dc-9a24-f7a83043cbc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:14.425746 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3f5b3-c614-46dc-9a24-f7a83043cbc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:14.429471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3f5b3-c614-46dc-9a24-f7a83043cbc5 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-1ab3f5b3-c614-46dc-9a24-f7a83043cbc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:41:14.440040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:14.441226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:14.442377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:41:14.442377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:41:14.442377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:41:14.442377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:41:14.442377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:41:14.442377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:41:14.442377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:41:14.442377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:14.442377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 636/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:14.447033 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3014dcf-ef57-4d94-9059-d59bafb69134 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:14.513660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:14.562689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3014dcf-ef57-4d94-9059-d59bafb69134 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:14.603022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42680a-4121-4ca6-a992-81a2f576d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:14.603636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42680a-4121-4ca6-a992-81a2f576d2cc None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:14.603910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42680a-4121-4ca6-a992-81a2f576d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:14.604174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42680a-4121-4ca6-a992-81a2f576d2cc None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:14.604900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42680a-4121-4ca6-a992-81a2f576d2cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:14.605204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42680a-4121-4ca6-a992-81a2f576d2cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:14.607175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42680a-4121-4ca6-a992-81a2f576d2cc None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:14.619679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 636/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:41:14.626628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3f5b3-c614-46dc-9a24-f7a83043cbc5 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:14.730629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:14.740469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3f5b3-c614-46dc-9a24-f7a83043cbc5 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:14.774831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b979c07-018d-4638-a033-733390277323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:14.778187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b979c07-018d-4638-a033-733390277323 None admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:14.778187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b979c07-018d-4638-a033-733390277323 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:14.778187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b979c07-018d-4638-a033-733390277323 None admin] PATH_INFO: `/v3/projects/daa3335d89fb42ec8ac663773f411098/users/9ecb4e7e9e3042adadd93229f8456eca/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:14.778187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b979c07-018d-4638-a033-733390277323 None admin] RBAC: Authorizing `identity:create_grant(project_id=daa3335d89fb42ec8ac663773f411098, user_id=9ecb4e7e9e3042adadd93229f8456eca, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:14.779435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b979c07-018d-4638-a033-733390277323 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:14.884397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 637/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 15:41:14 2022] PUT /identity/v3/projects/daa3335d89fb42ec8ac663773f411098/users/9ecb4e7e9e3042adadd93229f8456eca/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:41:16.835548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffddc5c-5a24-4623-9878-a0bb803ee660 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:16.836123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffddc5c-5a24-4623-9878-a0bb803ee660 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:16.836123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffddc5c-5a24-4623-9878-a0bb803ee660 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:16.837485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 637/1274] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:41:16.843417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe48e-0990-43b5-bdef-64db9af34fd8 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:16.843841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe48e-0990-43b5-bdef-64db9af34fd8 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:16.843954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe48e-0990-43b5-bdef-64db9af34fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:16.863308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-00abe48e-0990-43b5-bdef-64db9af34fd8 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:41:16.864572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-00abe48e-0990-43b5-bdef-64db9af34fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:41:16.948332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 638/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:41:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:41:17.223834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffddc5c-5a24-4623-9878-a0bb803ee660 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:17.337957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffddc5c-5a24-4623-9878-a0bb803ee660 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:17.356589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:17.377455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718d095-4233-45a4-b2d1-1d3fc4886550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:17.378090 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d095-4233-45a4-b2d1-1d3fc4886550 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:17.378369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d095-4233-45a4-b2d1-1d3fc4886550 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:17.378640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718d095-4233-45a4-b2d1-1d3fc4886550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:17.389693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718d095-4233-45a4-b2d1-1d3fc4886550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-c718d095-4233-45a4-b2d1-1d3fc4886550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:41:17.394528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:17.395680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:17.396757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 638/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 15:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:17.403160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe48e-0990-43b5-bdef-64db9af34fd8 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:17.489749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:17.508233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe48e-0990-43b5-bdef-64db9af34fd8 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:17.543359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a8c0f-89c8-416d-94eb-026654aebbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:17.543983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a8c0f-89c8-416d-94eb-026654aebbc1 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:17.544359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a8c0f-89c8-416d-94eb-026654aebbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:17.544591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a8c0f-89c8-416d-94eb-026654aebbc1 None admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:17.545264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a8c0f-89c8-416d-94eb-026654aebbc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:17.545564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a8c0f-89c8-416d-94eb-026654aebbc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:17.546958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a8c0f-89c8-416d-94eb-026654aebbc1 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:17.556349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 639/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 15:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:41:17.563204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718d095-4233-45a4-b2d1-1d3fc4886550 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:17.667608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718d095-4233-45a4-b2d1-1d3fc4886550 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:17.703101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c36f9-a67f-4aee-bc70-ca23950e0791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:17.703736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c36f9-a67f-4aee-bc70-ca23950e0791 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:17.704010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c36f9-a67f-4aee-bc70-ca23950e0791 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:17.704277 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c36f9-a67f-4aee-bc70-ca23950e0791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:17.715765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c36f9-a67f-4aee-bc70-ca23950e0791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:17.717268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c36f9-a67f-4aee-bc70-ca23950e0791 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-d13c36f9-a67f-4aee-bc70-ca23950e0791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:41:17.733275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:17.734655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:41:17.735702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:41:17.735702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:17.735702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:17.737749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 639/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:17.742529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a8c0f-89c8-416d-94eb-026654aebbc1 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:17.851893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a8c0f-89c8-416d-94eb-026654aebbc1 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:17.892962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7433e7-3cd5-48c3-b1d0-5e93d381f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:17.893602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7433e7-3cd5-48c3-b1d0-5e93d381f8ea None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:17.893884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7433e7-3cd5-48c3-b1d0-5e93d381f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:17.894186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7433e7-3cd5-48c3-b1d0-5e93d381f8ea None admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:17.894834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7433e7-3cd5-48c3-b1d0-5e93d381f8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:17.895162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7433e7-3cd5-48c3-b1d0-5e93d381f8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:17.896564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7433e7-3cd5-48c3-b1d0-5e93d381f8ea None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:17.911244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 640/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:41:17.917121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c36f9-a67f-4aee-bc70-ca23950e0791 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:17.950072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:18.027915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c36f9-a67f-4aee-bc70-ca23950e0791 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:18.065206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bce6d-b165-4d41-8eda-5c883793a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:18.065839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bce6d-b165-4d41-8eda-5c883793a7ad None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:18.066115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bce6d-b165-4d41-8eda-5c883793a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:18.066388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bce6d-b165-4d41-8eda-5c883793a7ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:18.075655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bce6d-b165-4d41-8eda-5c883793a7ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:18.085657 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bce6d-b165-4d41-8eda-5c883793a7ad None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-406bce6d-b165-4d41-8eda-5c883793a7ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:41:18.089359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:18.090816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:18.092016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 640/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:18.097389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7433e7-3cd5-48c3-b1d0-5e93d381f8ea None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:18.101321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:18.201430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7433e7-3cd5-48c3-b1d0-5e93d381f8ea None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:18.235697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd3923-816e-4a40-97b4-a7970e208f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:18.236346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3923-816e-4a40-97b4-a7970e208f83 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:18.236658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3923-816e-4a40-97b4-a7970e208f83 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:18.236933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3923-816e-4a40-97b4-a7970e208f83 None admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:18.237669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd3923-816e-4a40-97b4-a7970e208f83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:18.237975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd3923-816e-4a40-97b4-a7970e208f83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:18.239418 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd3923-816e-4a40-97b4-a7970e208f83 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:18.258760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 641/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 15:41:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:18.265341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bce6d-b165-4d41-8eda-5c883793a7ad None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:18.372124 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:18.383617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bce6d-b165-4d41-8eda-5c883793a7ad None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:18.419250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83e227-9ee0-4445-949b-ccb0f71fa6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:18.419963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83e227-9ee0-4445-949b-ccb0f71fa6da None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:18.420239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83e227-9ee0-4445-949b-ccb0f71fa6da None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:18.420555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83e227-9ee0-4445-949b-ccb0f71fa6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:18.493684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83e227-9ee0-4445-949b-ccb0f71fa6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:18.495284 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83e227-9ee0-4445-949b-ccb0f71fa6da None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:18.600428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:18.614422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 641/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 15:41:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:41:18.620275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd3923-816e-4a40-97b4-a7970e208f83 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:18.695779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:18.730325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd3923-816e-4a40-97b4-a7970e208f83 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:18.765430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3c041-ebda-4519-adae-14a9099686d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:18.766377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3c041-ebda-4519-adae-14a9099686d0 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:18.766377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3c041-ebda-4519-adae-14a9099686d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:18.766589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3c041-ebda-4519-adae-14a9099686d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:18.777082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3c041-ebda-4519-adae-14a9099686d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:18.779891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3c041-ebda-4519-adae-14a9099686d0 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-a4d3c041-ebda-4519-adae-14a9099686d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:41:18.797747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:18.799095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:41:18.800445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:41:18.800445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:41:18.800445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:18.800445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 642/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:18.804973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83e227-9ee0-4445-949b-ccb0f71fa6da None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:18.912352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83e227-9ee0-4445-949b-ccb0f71fa6da None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:18.950334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1e517-cc87-44f5-a798-085a4e4fde1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:18.950999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e517-cc87-44f5-a798-085a4e4fde1e None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:18.951111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e517-cc87-44f5-a798-085a4e4fde1e None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:18.953175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e517-cc87-44f5-a798-085a4e4fde1e None admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:18.953175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1e517-cc87-44f5-a798-085a4e4fde1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:18.953175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1e517-cc87-44f5-a798-085a4e4fde1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:18.953877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1e517-cc87-44f5-a798-085a4e4fde1e None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:18.966568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 642/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 15:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:18.972699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3c041-ebda-4519-adae-14a9099686d0 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:19.079477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3c041-ebda-4519-adae-14a9099686d0 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:19.095094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:19.116671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b5041-7b5e-4138-84bd-1a50ce618864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:19.117401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5041-7b5e-4138-84bd-1a50ce618864 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:19.117682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5041-7b5e-4138-84bd-1a50ce618864 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:19.117962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b5041-7b5e-4138-84bd-1a50ce618864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:19.125255 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b5041-7b5e-4138-84bd-1a50ce618864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:19.126708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b5041-7b5e-4138-84bd-1a50ce618864 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application [None req-390b5041-7b5e-4138-84bd-1a50ce618864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:41:19.140244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:19.141833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:19.143388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:41:19.143388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:41:19.143388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:41:19.143388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:41:19.143388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:41:19.143388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:41:19.143388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:41:19.143388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: ERROR keystone.server.flask.application Aug 22 15:41:19.143388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 643/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 15:41:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:19.147601 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1e517-cc87-44f5-a798-085a4e4fde1e None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:19.201321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:19.254631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1e517-cc87-44f5-a798-085a4e4fde1e None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:19.291300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9500b-64a6-4625-b935-df430e5fd8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:19.291916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9500b-64a6-4625-b935-df430e5fd8d0 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:19.292195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9500b-64a6-4625-b935-df430e5fd8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:19.292465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9500b-64a6-4625-b935-df430e5fd8d0 None admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:19.293224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9500b-64a6-4625-b935-df430e5fd8d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:19.293531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9500b-64a6-4625-b935-df430e5fd8d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:19.294964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9500b-64a6-4625-b935-df430e5fd8d0 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:19.308706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 643/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 15:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:19.315198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b5041-7b5e-4138-84bd-1a50ce618864 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:19.423949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b5041-7b5e-4138-84bd-1a50ce618864 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:19.460698 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041aaab-cd80-4478-986b-bff66f906877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:19.461240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041aaab-cd80-4478-986b-bff66f906877 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:19.461517 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041aaab-cd80-4478-986b-bff66f906877 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:19.461795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041aaab-cd80-4478-986b-bff66f906877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:19.462574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041aaab-cd80-4478-986b-bff66f906877 None admin] RBAC: Adding query filter params (role.id=eeb6551eeb934053866fc821b511b5dd, scope.project.id=daa3335d89fb42ec8ac663773f411098, user.id=9ecb4e7e9e3042adadd93229f8456eca) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:19.462883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041aaab-cd80-4478-986b-bff66f906877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:19.464398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041aaab-cd80-4478-986b-bff66f906877 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:19.471429 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 644/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 15:41:19 2022] GET /identity/v3/role_assignments?user.id=9ecb4e7e9e3042adadd93229f8456eca&scope.project.id=daa3335d89fb42ec8ac663773f411098&role.id=eeb6551eeb934053866fc821b511b5dd => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:21.485335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467f1e-9767-4e71-94c5-37deed957a2a None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:21.485923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467f1e-9767-4e71-94c5-37deed957a2a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:21.485923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467f1e-9767-4e71-94c5-37deed957a2a None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:21.487340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 644/1288] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:41:21.493329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920784f-1cb7-463d-a1a4-05b12210f2bf None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:21.494037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920784f-1cb7-463d-a1a4-05b12210f2bf None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:21.494037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920784f-1cb7-463d-a1a4-05b12210f2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:21.513799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-9920784f-1cb7-463d-a1a4-05b12210f2bf None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:41:21.515022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9920784f-1cb7-463d-a1a4-05b12210f2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:41:21.551414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:21.594947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 645/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:41:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:41:21.868809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467f1e-9767-4e71-94c5-37deed957a2a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:21.984576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467f1e-9767-4e71-94c5-37deed957a2a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:21.997271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:22.024777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f8179-0fb8-482c-b331-f9c461902a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:22.025420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f8179-0fb8-482c-b331-f9c461902a79 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:22.025699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f8179-0fb8-482c-b331-f9c461902a79 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:22.025970 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f8179-0fb8-482c-b331-f9c461902a79 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:22.026560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f8179-0fb8-482c-b331-f9c461902a79 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:22.028428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f8179-0fb8-482c-b331-f9c461902a79 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9c3f8179-0fb8-482c-b331-f9c461902a79 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:22.037524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:22.039056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:22.040316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 645/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 15:41:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:22.045470 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920784f-1cb7-463d-a1a4-05b12210f2bf None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:22.160944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920784f-1cb7-463d-a1a4-05b12210f2bf None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:22.203115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faa928-1e34-4140-a35c-477905721626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:22.203741 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faa928-1e34-4140-a35c-477905721626 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:22.204021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faa928-1e34-4140-a35c-477905721626 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:22.204290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faa928-1e34-4140-a35c-477905721626 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:22.204958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5faa928-1e34-4140-a35c-477905721626 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:22.205259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5faa928-1e34-4140-a35c-477905721626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:22.206654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5faa928-1e34-4140-a35c-477905721626 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:22.212231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 646/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Aug 22 15:41:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:22.218799 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f8179-0fb8-482c-b331-f9c461902a79 None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:22.332234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f8179-0fb8-482c-b331-f9c461902a79 None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:22.374994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68932852-b92a-4ece-8f99-52f9f1c5e5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:22.375601 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68932852-b92a-4ece-8f99-52f9f1c5e5c1 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:22.375869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68932852-b92a-4ece-8f99-52f9f1c5e5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:22.376142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68932852-b92a-4ece-8f99-52f9f1c5e5c1 None admin] PATH_INFO: `/v3/services` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:22.376808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68932852-b92a-4ece-8f99-52f9f1c5e5c1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:22.377109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68932852-b92a-4ece-8f99-52f9f1c5e5c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:22.378496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68932852-b92a-4ece-8f99-52f9f1c5e5c1 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:22.383469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 646/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Aug 22 15:41:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:24.392062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d7682-1335-494d-a1da-d1d37c69e6e6 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:24.392836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d7682-1335-494d-a1da-d1d37c69e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:24.392836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d7682-1335-494d-a1da-d1d37c69e6e6 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:24.394127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 647/1293] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:41:24.399860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc293e-2cad-421c-8cc1-e8c6eeb0b476 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:24.400327 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc293e-2cad-421c-8cc1-e8c6eeb0b476 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:24.402243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc293e-2cad-421c-8cc1-e8c6eeb0b476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:24.419555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-29bc293e-2cad-421c-8cc1-e8c6eeb0b476 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:41:24.420844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-29bc293e-2cad-421c-8cc1-e8c6eeb0b476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:41:24.452063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:24.492310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 647/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:41:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:41:24.775113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d7682-1335-494d-a1da-d1d37c69e6e6 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:24.809157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:24.884650 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d7682-1335-494d-a1da-d1d37c69e6e6 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:24.921989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b88bb0-5ae4-489b-b18d-27c8d104c3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:24.922864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b88bb0-5ae4-489b-b18d-27c8d104c3d4 None admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:24.923157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b88bb0-5ae4-489b-b18d-27c8d104c3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:24.923463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b88bb0-5ae4-489b-b18d-27c8d104c3d4 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:24.924188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b88bb0-5ae4-489b-b18d-27c8d104c3d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:24.925625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b88bb0-5ae4-489b-b18d-27c8d104c3d4 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:25.047620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 648/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 15:41:24 2022] POST /identity/v3/services => generated 246 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:41:27.010685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e7920-2a1c-46ad-89f9-19dca9b57262 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:27.011244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e7920-2a1c-46ad-89f9-19dca9b57262 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:27.011244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e7920-2a1c-46ad-89f9-19dca9b57262 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:27.013192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 648/1296] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:41:27.018891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2659ab-dcb1-42ad-9f8e-801e4437fff6 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:27.019382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2659ab-dcb1-42ad-9f8e-801e4437fff6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:27.019494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2659ab-dcb1-42ad-9f8e-801e4437fff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:27.037489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-ff2659ab-dcb1-42ad-9f8e-801e4437fff6 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:41:27.039087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ff2659ab-dcb1-42ad-9f8e-801e4437fff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:41:27.116757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 649/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:41:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:41:27.388343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e7920-2a1c-46ad-89f9-19dca9b57262 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:27.504491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e7920-2a1c-46ad-89f9-19dca9b57262 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:27.541346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf432c1-4db6-4223-aedc-b0367e37d58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:27.542350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf432c1-4db6-4223-aedc-b0367e37d58c None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:27.543283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf432c1-4db6-4223-aedc-b0367e37d58c None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:27.543723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf432c1-4db6-4223-aedc-b0367e37d58c None admin] PATH_INFO: `/v3/services/placement` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:27.544639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf432c1-4db6-4223-aedc-b0367e37d58c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:27.546764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf432c1-4db6-4223-aedc-b0367e37d58c None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-9cf432c1-4db6-4223-aedc-b0367e37d58c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:27.559606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:27.561954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:27.563704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 649/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 15:41:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:27.569770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2659ab-dcb1-42ad-9f8e-801e4437fff6 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:27.585379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:27.667094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2659ab-dcb1-42ad-9f8e-801e4437fff6 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:27.709559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa95c30-e422-43d9-a198-7ea891295f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:27.710179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95c30-e422-43d9-a198-7ea891295f12 None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:27.710455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95c30-e422-43d9-a198-7ea891295f12 None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:27.710722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95c30-e422-43d9-a198-7ea891295f12 None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:27.711350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95c30-e422-43d9-a198-7ea891295f12 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:27.711648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95c30-e422-43d9-a198-7ea891295f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:27.713150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95c30-e422-43d9-a198-7ea891295f12 None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:27.718336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 650/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Aug 22 15:41:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:27.724555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf432c1-4db6-4223-aedc-b0367e37d58c None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:27.758859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:27.831789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf432c1-4db6-4223-aedc-b0367e37d58c None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:27.866741 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd152e-1c61-42a2-bc4f-d3961eebcd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:27.867346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd152e-1c61-42a2-bc4f-d3961eebcd03 None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:27.867620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd152e-1c61-42a2-bc4f-d3961eebcd03 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:27.867881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd152e-1c61-42a2-bc4f-d3961eebcd03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:27.868606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd152e-1c61-42a2-bc4f-d3961eebcd03 None admin] RBAC: Adding query filter params (interface=public, service_id=d5aaaac4536f4339a6d3bde1d94be4c3, region_id=RegionOne) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:27.868912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd152e-1c61-42a2-bc4f-d3961eebcd03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:27.870286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd152e-1c61-42a2-bc4f-d3961eebcd03 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:27.875777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 650/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 15:41:27 2022] GET /identity/v3/endpoints?service_id=d5aaaac4536f4339a6d3bde1d94be4c3&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:27.882527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa95c30-e422-43d9-a198-7ea891295f12 None admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:27.973645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:27.992095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa95c30-e422-43d9-a198-7ea891295f12 None admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:28.028337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9e86a-7f37-4fc7-aa42-bb562c1065fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:28.037642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9e86a-7f37-4fc7-aa42-bb562c1065fc None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:28.037642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9e86a-7f37-4fc7-aa42-bb562c1065fc None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:28.037642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9e86a-7f37-4fc7-aa42-bb562c1065fc None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:28.037642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9e86a-7f37-4fc7-aa42-bb562c1065fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:28.037642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9e86a-7f37-4fc7-aa42-bb562c1065fc None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:28.038504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 651/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 15:41:27 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:41:30.089767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23941b-ecee-4bed-a0d2-aacd6179d8c5 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:30.090424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23941b-ecee-4bed-a0d2-aacd6179d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:30.090424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23941b-ecee-4bed-a0d2-aacd6179d8c5 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:30.091682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 651/1302] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:41:30.099211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d17f08-9ea3-418f-bc66-5ca767dcd843 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:30.099761 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d17f08-9ea3-418f-bc66-5ca767dcd843 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:30.100165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d17f08-9ea3-418f-bc66-5ca767dcd843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:30.118949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-34d17f08-9ea3-418f-bc66-5ca767dcd843 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:41:30.120151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-34d17f08-9ea3-418f-bc66-5ca767dcd843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:41:30.188350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 652/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:41:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:41:30.455193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23941b-ecee-4bed-a0d2-aacd6179d8c5 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:30.556849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:30.564104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23941b-ecee-4bed-a0d2-aacd6179d8c5 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:30.604292 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47ddd-3a33-48b6-9309-84992204d45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:30.605824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47ddd-3a33-48b6-9309-84992204d45b None admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:30.606284 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47ddd-3a33-48b6-9309-84992204d45b None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:30.606754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47ddd-3a33-48b6-9309-84992204d45b None admin] PATH_INFO: `/v3/services/placement` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:30.607723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47ddd-3a33-48b6-9309-84992204d45b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:30.609324 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47ddd-3a33-48b6-9309-84992204d45b None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application [None req-87d47ddd-3a33-48b6-9309-84992204d45b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:41:30.620377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:41:30.622304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application with Lock( Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: ERROR keystone.server.flask.application Aug 22 15:41:30.623403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 652/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 15:41:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:41:30.629200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d17f08-9ea3-418f-bc66-5ca767dcd843 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:30.711127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:30.735349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d17f08-9ea3-418f-bc66-5ca767dcd843 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:30.773234 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966f898-52af-412f-94da-b35f67e04fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:30.773844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966f898-52af-412f-94da-b35f67e04fce None admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:30.774120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966f898-52af-412f-94da-b35f67e04fce None admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:30.774385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966f898-52af-412f-94da-b35f67e04fce None admin] PATH_INFO: `/v3/services` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:30.775006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966f898-52af-412f-94da-b35f67e04fce None admin] RBAC: Adding query filter params (name=placement) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:41:30.775303 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966f898-52af-412f-94da-b35f67e04fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:30.776700 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966f898-52af-412f-94da-b35f67e04fce None admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:30.783260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 653/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Aug 22 15:41:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:41:30.789237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47ddd-3a33-48b6-9309-84992204d45b None admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:41:30.897695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47ddd-3a33-48b6-9309-84992204d45b None admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:41:30.936019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f52ab9-95c9-4552-a641-e2b8bc8e2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:41:30.936648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f52ab9-95c9-4552-a641-e2b8bc8e2506 None admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:41:30.936928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f52ab9-95c9-4552-a641-e2b8bc8e2506 None admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:41:30.937198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f52ab9-95c9-4552-a641-e2b8bc8e2506 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:41:30.937876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f52ab9-95c9-4552-a641-e2b8bc8e2506 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:41:30.939252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f52ab9-95c9-4552-a641-e2b8bc8e2506 None admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:41:31.057246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 653/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:41:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:41:40.779510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=30 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:41:41.052536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:33.299165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b7579-5a0d-4e5b-9802-8a27d745e2d7 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:33.299798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b7579-5a0d-4e5b-9802-8a27d745e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:33.300201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b7579-5a0d-4e5b-9802-8a27d745e2d7 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:33.309839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb9aec-8c26-4ff5-8041-f5b3c25b1a6b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:33.310500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb9aec-8c26-4ff5-8041-f5b3c25b1a6b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:33.310991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb9aec-8c26-4ff5-8041-f5b3c25b1a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:33.317507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 654/1307] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:48:33 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:33.422642 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-43bb9aec-8c26-4ff5-8041-f5b3c25b1a6b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:33.424168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-43bb9aec-8c26-4ff5-8041-f5b3c25b1a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:33.563390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 654/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:48:33.898959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8adee3-1fca-4b52-aeb0-9fa22f93e2a4 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:33.899576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8adee3-1fca-4b52-aeb0-9fa22f93e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:33.900098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8adee3-1fca-4b52-aeb0-9fa22f93e2a4 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:33.902878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 655/1309] 10.222.0.18 () {54 vars in 965 bytes} [Mon Aug 22 15:48:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:33.913986 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4125a4-b913-47cc-b768-eb5b8ccd0bc5 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:33.914403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4125a4-b913-47cc-b768-eb5b8ccd0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:33.914587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4125a4-b913-47cc-b768-eb5b8ccd0bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:34.128303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-2d4125a4-b913-47cc-b768-eb5b8ccd0bc5 None None] MFA Rules not processed for user `90324fa56d0743699f2fddd17fb630dd`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:34.131859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2d4125a4-b913-47cc-b768-eb5b8ccd0bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:34.177382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:34.313826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 655/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Mon Aug 22 15:48:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:48:34.324005 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8adee3-1fca-4b52-aeb0-9fa22f93e2a4 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:34.326484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6d8adee3-1fca-4b52-aeb0-9fa22f93e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:34.457778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8adee3-1fca-4b52-aeb0-9fa22f93e2a4 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:34.544958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077f579-3159-4a27-9f70-776cb1f03758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:34.545887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f579-3159-4a27-9f70-776cb1f03758 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:34.546323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f579-3159-4a27-9f70-776cb1f03758 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:34.546748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077f579-3159-4a27-9f70-776cb1f03758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:34.548874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b077f579-3159-4a27-9f70-776cb1f03758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:34.647909 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:34.731041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077f579-3159-4a27-9f70-776cb1f03758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:34.733430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077f579-3159-4a27-9f70-776cb1f03758 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:34.760866 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 656/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:48:37.453208 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfdd6d-0e19-4c5c-a9da-bb35b198dabe None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.453898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfdd6d-0e19-4c5c-a9da-bb35b198dabe None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.453898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfdd6d-0e19-4c5c-a9da-bb35b198dabe None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.455111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 656/1312] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:37.460869 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262fe55-7977-4e51-9e56-8a7e600c9e40 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.461613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262fe55-7977-4e51-9e56-8a7e600c9e40 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.461768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262fe55-7977-4e51-9e56-8a7e600c9e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.543259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-7262fe55-7977-4e51-9e56-8a7e600c9e40 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:37.545310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7262fe55-7977-4e51-9e56-8a7e600c9e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:37.655544 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 657/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:48:37.947778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfdd6d-0e19-4c5c-a9da-bb35b198dabe None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:37.949399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-07bfdd6d-0e19-4c5c-a9da-bb35b198dabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:38.068564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfdd6d-0e19-4c5c-a9da-bb35b198dabe None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:38.146768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:38.151210 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc31523-1235-4299-8dc5-77365434ac88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:38.152238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc31523-1235-4299-8dc5-77365434ac88 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:38.152751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc31523-1235-4299-8dc5-77365434ac88 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:38.153224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc31523-1235-4299-8dc5-77365434ac88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:38.156252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9cc31523-1235-4299-8dc5-77365434ac88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:38.334975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc31523-1235-4299-8dc5-77365434ac88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:38.336440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc31523-1235-4299-8dc5-77365434ac88 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:38.356375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 657/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:48:41.205357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23178c1e-d8e8-4382-a4a5-8fef3000da43 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:41.205959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23178c1e-d8e8-4382-a4a5-8fef3000da43 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:41.205959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23178c1e-d8e8-4382-a4a5-8fef3000da43 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:41.207406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 658/1315] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:41.213591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327c9a8-225c-4090-8242-3f294ea62f0b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:41.214160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327c9a8-225c-4090-8242-3f294ea62f0b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:41.214160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327c9a8-225c-4090-8242-3f294ea62f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:41.292106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-1327c9a8-225c-4090-8242-3f294ea62f0b None None] MFA Rules not processed for user `7476173827d74a3aac24510fe72e7a53`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:41.293390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1327c9a8-225c-4090-8242-3f294ea62f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:41.355396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:41.405796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 658/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:48:41.705528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466799d-565f-430e-9e11-f4cab1f35688 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:41.705806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466799d-565f-430e-9e11-f4cab1f35688 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:41.706079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466799d-565f-430e-9e11-f4cab1f35688 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:41.707439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 659/1317] 10.222.0.18 () {54 vars in 965 bytes} [Mon Aug 22 15:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:41.714520 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ab67-ab38-43c8-a7e4-af6ee6033036 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:41.714800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ab67-ab38-43c8-a7e4-af6ee6033036 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:41.715069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ab67-ab38-43c8-a7e4-af6ee6033036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:41.796971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-5ca5ab67-ab38-43c8-a7e4-af6ee6033036 None None] MFA Rules not processed for user `90324fa56d0743699f2fddd17fb630dd`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:41.798206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5ca5ab67-ab38-43c8-a7e4-af6ee6033036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:41.881292 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 659/1318] 10.222.0.18 () {58 vars in 1062 bytes} [Mon Aug 22 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:48:41.891142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466799d-565f-430e-9e11-f4cab1f35688 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:41.893783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9466799d-565f-430e-9e11-f4cab1f35688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:41.910025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:42.038389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466799d-565f-430e-9e11-f4cab1f35688 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:42.119821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e8e19-a781-45ef-8448-8507b308046b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:42.120433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e8e19-a781-45ef-8448-8507b308046b service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:42.120737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e8e19-a781-45ef-8448-8507b308046b service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:42.121001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e8e19-a781-45ef-8448-8507b308046b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:42.122622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4d1e8e19-a781-45ef-8448-8507b308046b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:42.190196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:42.242546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e8e19-a781-45ef-8448-8507b308046b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:42.243994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e8e19-a781-45ef-8448-8507b308046b service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:42.263386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 660/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:48:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:48:45.541336 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a6ba-92c1-4a9c-928a-9c72f5a75c8b None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:45.542045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a6ba-92c1-4a9c-928a-9c72f5a75c8b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:45.542045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67a6ba-92c1-4a9c-928a-9c72f5a75c8b None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:45.543131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 660/1320] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:45.548767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b612-4272-4024-b02b-a4b719140782 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:45.549215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b612-4272-4024-b02b-a4b719140782 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:45.549376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b612-4272-4024-b02b-a4b719140782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:45.617565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-eea8b612-4272-4024-b02b-a4b719140782 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:45.618782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-eea8b612-4272-4024-b02b-a4b719140782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:45.716281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 661/1321] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:48:46.000329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a6ba-92c1-4a9c-928a-9c72f5a75c8b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:46.001924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fe67a6ba-92c1-4a9c-928a-9c72f5a75c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:46.052018 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:46.106774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67a6ba-92c1-4a9c-928a-9c72f5a75c8b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:46.181076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ca4d5-e6ef-4d9b-b230-b4d9201e7adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:46.181682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ca4d5-e6ef-4d9b-b230-b4d9201e7adc service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:46.181953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ca4d5-e6ef-4d9b-b230-b4d9201e7adc service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:46.182215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ca4d5-e6ef-4d9b-b230-b4d9201e7adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:46.183802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9c0ca4d5-e6ef-4d9b-b230-b4d9201e7adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:46.278373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:46.292200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ca4d5-e6ef-4d9b-b230-b4d9201e7adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:46.293724 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ca4d5-e6ef-4d9b-b230-b4d9201e7adc service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:46.312117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 661/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:48:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:48:49.531816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874138f5-95cd-415e-a649-499d2ee7b473 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:49.532355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874138f5-95cd-415e-a649-499d2ee7b473 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:49.532355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874138f5-95cd-415e-a649-499d2ee7b473 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:49.533783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 662/1323] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:49.540003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a71650-a566-4e84-8caf-bfd692ce425e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:49.541022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a71650-a566-4e84-8caf-bfd692ce425e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:49.541022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a71650-a566-4e84-8caf-bfd692ce425e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:49.613382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-43a71650-a566-4e84-8caf-bfd692ce425e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:49.615159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-43a71650-a566-4e84-8caf-bfd692ce425e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:49.721971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 662/1324] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:48:50.010172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874138f5-95cd-415e-a649-499d2ee7b473 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:50.011846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-874138f5-95cd-415e-a649-499d2ee7b473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:50.036340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:50.136992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874138f5-95cd-415e-a649-499d2ee7b473 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:50.218025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46961ab5-0f81-40e8-af3d-fe39bfb2aac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:50.218537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46961ab5-0f81-40e8-af3d-fe39bfb2aac2 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:50.218809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46961ab5-0f81-40e8-af3d-fe39bfb2aac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:50.219074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46961ab5-0f81-40e8-af3d-fe39bfb2aac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:50.220879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-46961ab5-0f81-40e8-af3d-fe39bfb2aac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:50.304346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:50.351206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46961ab5-0f81-40e8-af3d-fe39bfb2aac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:50.352727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46961ab5-0f81-40e8-af3d-fe39bfb2aac2 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:50.373667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 663/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:48:53.463873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c86146-be07-4349-91d0-e18d5040f91a None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:53.464450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c86146-be07-4349-91d0-e18d5040f91a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:53.464717 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c86146-be07-4349-91d0-e18d5040f91a None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:53.466927 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 663/1326] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:48:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:53.475787 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa0dae-3c41-46ab-a7b4-80f93f48f42f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:53.476320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa0dae-3c41-46ab-a7b4-80f93f48f42f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:53.476674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa0dae-3c41-46ab-a7b4-80f93f48f42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:53.585606 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3dfa0dae-3c41-46ab-a7b4-80f93f48f42f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:53.587333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3dfa0dae-3c41-46ab-a7b4-80f93f48f42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:53.715091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 664/1327] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:48:54.069937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c86146-be07-4349-91d0-e18d5040f91a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:54.071791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-97c86146-be07-4349-91d0-e18d5040f91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:54.155514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:54.213085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c86146-be07-4349-91d0-e18d5040f91a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:54.338016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d7520-257b-47b6-b07e-0e15d74eda3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:54.339071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d7520-257b-47b6-b07e-0e15d74eda3a service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:54.339557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d7520-257b-47b6-b07e-0e15d74eda3a service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:54.340008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d7520-257b-47b6-b07e-0e15d74eda3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:54.342628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-667d7520-257b-47b6-b07e-0e15d74eda3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:54.510269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:54.513925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d7520-257b-47b6-b07e-0e15d74eda3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:54.516601 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d7520-257b-47b6-b07e-0e15d74eda3a service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:54.549931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 664/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:48:56.769577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daa9a3-f8b1-4d9a-9106-cebbb5be9556 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:56.770919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daa9a3-f8b1-4d9a-9106-cebbb5be9556 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:56.770919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daa9a3-f8b1-4d9a-9106-cebbb5be9556 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:56.772462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 665/1329] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:48:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:56.779301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43d20-bff5-4ead-9d37-1210a96ac7ca None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:56.780011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43d20-bff5-4ead-9d37-1210a96ac7ca None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:56.780179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43d20-bff5-4ead-9d37-1210a96ac7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:56.877643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7db43d20-bff5-4ead-9d37-1210a96ac7ca None None] MFA Rules not processed for user `7476173827d74a3aac24510fe72e7a53`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:56.879336 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7db43d20-bff5-4ead-9d37-1210a96ac7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:57.019300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 665/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:48:57.316090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daa9a3-f8b1-4d9a-9106-cebbb5be9556 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:57.318260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b3daa9a3-f8b1-4d9a-9106-cebbb5be9556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:57.370570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:57.489591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daa9a3-f8b1-4d9a-9106-cebbb5be9556 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:57.601505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89fe0f-7d2c-4069-840a-f83374a6f155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:57.602462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89fe0f-7d2c-4069-840a-f83374a6f155 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:57.602938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89fe0f-7d2c-4069-840a-f83374a6f155 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:57.603362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89fe0f-7d2c-4069-840a-f83374a6f155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:57.605167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5d89fe0f-7d2c-4069-840a-f83374a6f155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:57.701294 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:57.735924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89fe0f-7d2c-4069-840a-f83374a6f155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:57.737547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89fe0f-7d2c-4069-840a-f83374a6f155 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:57.758050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 666/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:48:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:00.446031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb206a6-6dd0-42f5-bcc1-50291259d070 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:00.453945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb206a6-6dd0-42f5-bcc1-50291259d070 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:00.453945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb206a6-6dd0-42f5-bcc1-50291259d070 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:00.453945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 666/1332] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:49:00.454464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd2cb0-4dc8-4737-bc88-b5ddb82a6b76 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:00.455188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd2cb0-4dc8-4737-bc88-b5ddb82a6b76 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:00.455390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd2cb0-4dc8-4737-bc88-b5ddb82a6b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:00.536318 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b9fd2cb0-4dc8-4737-bc88-b5ddb82a6b76 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:00.537576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b9fd2cb0-4dc8-4737-bc88-b5ddb82a6b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:00.645913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 667/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:49:00.935785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb206a6-6dd0-42f5-bcc1-50291259d070 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:00.937569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ddb206a6-6dd0-42f5-bcc1-50291259d070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:01.024808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:01.065230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb206a6-6dd0-42f5-bcc1-50291259d070 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:01.143022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dfd7b-f75a-4979-ba0e-d8f0777cd806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:01.143693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dfd7b-f75a-4979-ba0e-d8f0777cd806 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:01.143987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dfd7b-f75a-4979-ba0e-d8f0777cd806 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:01.144261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dfd7b-f75a-4979-ba0e-d8f0777cd806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:01.146435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ef3dfd7b-f75a-4979-ba0e-d8f0777cd806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:01.264067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dfd7b-f75a-4979-ba0e-d8f0777cd806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:01.265603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dfd7b-f75a-4979-ba0e-d8f0777cd806 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:01.277244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:01.287914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 667/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:03.356463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16354b-0142-4b0c-904c-338571346b67 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:03.357049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16354b-0142-4b0c-904c-338571346b67 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:03.357049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16354b-0142-4b0c-904c-338571346b67 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:03.358382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 668/1335] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:49:03.364233 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4955688-1fca-46f5-9fea-44ddddfb5ecc None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:03.364780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4955688-1fca-46f5-9fea-44ddddfb5ecc None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:03.365077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4955688-1fca-46f5-9fea-44ddddfb5ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:03.445142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-f4955688-1fca-46f5-9fea-44ddddfb5ecc None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:03.447174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f4955688-1fca-46f5-9fea-44ddddfb5ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:03.548972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 668/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:03.839627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16354b-0142-4b0c-904c-338571346b67 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:03.840433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ee16354b-0142-4b0c-904c-338571346b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:03.888959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:03.962842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16354b-0142-4b0c-904c-338571346b67 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:04.040496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2add1-4f44-4a73-b2a2-98afce34b9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:04.041128 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2add1-4f44-4a73-b2a2-98afce34b9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:04.041408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2add1-4f44-4a73-b2a2-98afce34b9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:04.041678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2add1-4f44-4a73-b2a2-98afce34b9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:04.043269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-68d2add1-4f44-4a73-b2a2-98afce34b9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:04.132900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:04.160074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2add1-4f44-4a73-b2a2-98afce34b9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:04.162123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2add1-4f44-4a73-b2a2-98afce34b9f5 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:04.180990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 669/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:49:07.206363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79f728-333f-47d8-be04-facbcb0d3553 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.206949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79f728-333f-47d8-be04-facbcb0d3553 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.207056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79f728-333f-47d8-be04-facbcb0d3553 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.208862 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 669/1338] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:07.214973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c3eb-bba2-4b72-bbaf-1e2c735cdecc None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.215597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c3eb-bba2-4b72-bbaf-1e2c735cdecc None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.215597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c3eb-bba2-4b72-bbaf-1e2c735cdecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.284323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-2f48c3eb-bba2-4b72-bbaf-1e2c735cdecc None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:07.286086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2f48c3eb-bba2-4b72-bbaf-1e2c735cdecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:07.390955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 670/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:07.678719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79f728-333f-47d8-be04-facbcb0d3553 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:07.680620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5b79f728-333f-47d8-be04-facbcb0d3553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:07.766394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:07.798587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79f728-333f-47d8-be04-facbcb0d3553 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:07.888621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4b434-6e30-48e6-81a4-764bf694fd3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:07.889249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4b434-6e30-48e6-81a4-764bf694fd3a service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.889619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4b434-6e30-48e6-81a4-764bf694fd3a service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.889883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4b434-6e30-48e6-81a4-764bf694fd3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.891520 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d1f4b434-6e30-48e6-81a4-764bf694fd3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:08.019532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4b434-6e30-48e6-81a4-764bf694fd3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:08.021573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4b434-6e30-48e6-81a4-764bf694fd3a service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:08.040616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 670/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:12.881835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a8c0-bca2-42ec-9348-0fc198061aa5 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.886074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a8c0-bca2-42ec-9348-0fc198061aa5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.886074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a8c0-bca2-42ec-9348-0fc198061aa5 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.886074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 671/1341] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:12.889377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c3c11-cae3-4a1e-a0d4-e1707215cf99 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.889784 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c3c11-cae3-4a1e-a0d4-e1707215cf99 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.889924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c3c11-cae3-4a1e-a0d4-e1707215cf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.895389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:12.961011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-962c3c11-cae3-4a1e-a0d4-e1707215cf99 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:12.962243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-962c3c11-cae3-4a1e-a0d4-e1707215cf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:13.064286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 671/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:49:13.358455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a8c0-bca2-42ec-9348-0fc198061aa5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:13.360137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6b90a8c0-bca2-42ec-9348-0fc198061aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:13.411469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:13.476915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a8c0-bca2-42ec-9348-0fc198061aa5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:13.552101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed957ae7-7510-44eb-82b0-440545966e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:13.552740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957ae7-7510-44eb-82b0-440545966e9e service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:13.553014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957ae7-7510-44eb-82b0-440545966e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:13.553280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957ae7-7510-44eb-82b0-440545966e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:13.554893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ed957ae7-7510-44eb-82b0-440545966e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:13.651324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:13.668739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed957ae7-7510-44eb-82b0-440545966e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:13.670092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed957ae7-7510-44eb-82b0-440545966e9e service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:13.689204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 672/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:16.928750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd988e-8f37-4ed6-9bf2-43a040f4c7ef None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:16.929346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd988e-8f37-4ed6-9bf2-43a040f4c7ef None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:16.929346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd988e-8f37-4ed6-9bf2-43a040f4c7ef None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:16.930843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 672/1344] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:16.936220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5c1e5-7d11-46aa-a663-2d686adfb54c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:16.936728 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5c1e5-7d11-46aa-a663-2d686adfb54c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:16.936826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5c1e5-7d11-46aa-a663-2d686adfb54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:17.004465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-8dc5c1e5-7d11-46aa-a663-2d686adfb54c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:17.005700 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8dc5c1e5-7d11-46aa-a663-2d686adfb54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:17.110126 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 673/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:17.396206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd988e-8f37-4ed6-9bf2-43a040f4c7ef None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:17.397809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f8fd988e-8f37-4ed6-9bf2-43a040f4c7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:17.501699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:17.519905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd988e-8f37-4ed6-9bf2-43a040f4c7ef None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:17.601975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0b2b0-d245-4771-b4ce-e051611fb1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:17.602580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b2b0-d245-4771-b4ce-e051611fb1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:17.602852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b2b0-d245-4771-b4ce-e051611fb1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:17.603118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b2b0-d245-4771-b4ce-e051611fb1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:17.604816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7ff0b2b0-d245-4771-b4ce-e051611fb1a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:17.719544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0b2b0-d245-4771-b4ce-e051611fb1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:17.721057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0b2b0-d245-4771-b4ce-e051611fb1a0 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:17.740768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 673/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:22.494297 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce83d3-9f51-4de9-8681-659a4f82e1b0 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:22.494831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce83d3-9f51-4de9-8681-659a4f82e1b0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:22.494831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce83d3-9f51-4de9-8681-659a4f82e1b0 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:22.496269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 674/1347] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:22.502158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7aa7c-4567-4da1-b250-8b741ef206ed None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:22.502680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7aa7c-4567-4da1-b250-8b741ef206ed None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:22.502680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7aa7c-4567-4da1-b250-8b741ef206ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:22.518637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:22.577989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-49a7aa7c-4567-4da1-b250-8b741ef206ed None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:22.579257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-49a7aa7c-4567-4da1-b250-8b741ef206ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:22.690968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 674/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:22.976027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce83d3-9f51-4de9-8681-659a4f82e1b0 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:22.977666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ebce83d3-9f51-4de9-8681-659a4f82e1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:23.038796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:23.091722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce83d3-9f51-4de9-8681-659a4f82e1b0 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:23.184367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d224aa-f3e2-4060-a745-d4a6d601e82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:23.185046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d224aa-f3e2-4060-a745-d4a6d601e82a service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:23.185338 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d224aa-f3e2-4060-a745-d4a6d601e82a service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:23.185605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d224aa-f3e2-4060-a745-d4a6d601e82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:23.187404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-06d224aa-f3e2-4060-a745-d4a6d601e82a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:23.332662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:23.337158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d224aa-f3e2-4060-a745-d4a6d601e82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:23.339368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d224aa-f3e2-4060-a745-d4a6d601e82a service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:23.360209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 675/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:28.450297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5ce69-c0b5-4606-b1f5-0304ff769e38 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.450758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5ce69-c0b5-4606-b1f5-0304ff769e38 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.451260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5ce69-c0b5-4606-b1f5-0304ff769e38 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.452391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 675/1350] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 15:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:28.459206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0ede1-a4c5-4c63-854b-5acbdf6938f7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.459823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0ede1-a4c5-4c63-854b-5acbdf6938f7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.460710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0ede1-a4c5-4c63-854b-5acbdf6938f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.589676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-a7f0ede1-a4c5-4c63-854b-5acbdf6938f7 None None] MFA Rules not processed for user `9ecb4e7e9e3042adadd93229f8456eca`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:28.591075 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a7f0ede1-a4c5-4c63-854b-5acbdf6938f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:28.778035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 676/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 15:49:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:32.689209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=59 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:33.282457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3609-93c6-48a8-82d5-2c4c06ef2c0c None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:33.282703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3609-93c6-48a8-82d5-2c4c06ef2c0c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:33.283009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3609-93c6-48a8-82d5-2c4c06ef2c0c None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:33.284645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 676/1352] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 15:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:33.290505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1477c85-e3de-4975-86a0-bd2b637e72e3 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:33.291035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1477c85-e3de-4975-86a0-bd2b637e72e3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:33.291282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1477c85-e3de-4975-86a0-bd2b637e72e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:33.358250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:33.385622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e1477c85-e3de-4975-86a0-bd2b637e72e3 None None] MFA Rules not processed for user `9ecb4e7e9e3042adadd93229f8456eca`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:33.387007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e1477c85-e3de-4975-86a0-bd2b637e72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:33.513829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 677/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:34.890704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e1e3f-a870-49a8-88b9-d08ab5d3d962 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.891332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e1e3f-a870-49a8-88b9-d08ab5d3d962 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.891332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e1e3f-a870-49a8-88b9-d08ab5d3d962 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.892617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 677/1354] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 15:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:34.898356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72306-d8f8-456d-a862-223c0e32fbe0 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.898804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72306-d8f8-456d-a862-223c0e32fbe0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.899045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b72306-d8f8-456d-a862-223c0e32fbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.996744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-23b72306-d8f8-456d-a862-223c0e32fbe0 None None] MFA Rules not processed for user `9ecb4e7e9e3042adadd93229f8456eca`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:34.997976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-23b72306-d8f8-456d-a862-223c0e32fbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:35.043185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:35.113735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 678/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 15:49:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:38.646298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481262c8-c016-45ea-be06-bfbbe8269401 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:38.646853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481262c8-c016-45ea-be06-bfbbe8269401 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:38.646963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481262c8-c016-45ea-be06-bfbbe8269401 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:38.648303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 678/1356] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:38.653771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac32ab-bcbd-4357-a286-c967f4d73e9b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:38.654236 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac32ab-bcbd-4357-a286-c967f4d73e9b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:38.654638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac32ab-bcbd-4357-a286-c967f4d73e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:38.744274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-26ac32ab-bcbd-4357-a286-c967f4d73e9b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:38.746069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-26ac32ab-bcbd-4357-a286-c967f4d73e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:38.880241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 679/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:49:39.215650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160659dc-d469-4e0d-869b-d0d94429fe68 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.216093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160659dc-d469-4e0d-869b-d0d94429fe68 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.216464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160659dc-d469-4e0d-869b-d0d94429fe68 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.218248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 679/1358] 10.222.0.18 () {54 vars in 962 bytes} [Mon Aug 22 15:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:39.226514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babba8f-d40d-4c56-a837-c3340d4006e2 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.227058 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babba8f-d40d-4c56-a837-c3340d4006e2 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.227520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babba8f-d40d-4c56-a837-c3340d4006e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.259767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.348981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4babba8f-d40d-4c56-a837-c3340d4006e2 None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:39.350482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4babba8f-d40d-4c56-a837-c3340d4006e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:39.479201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 680/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Aug 22 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:49:39.487704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160659dc-d469-4e0d-869b-d0d94429fe68 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:39.489254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-160659dc-d469-4e0d-869b-d0d94429fe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:39.652819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160659dc-d469-4e0d-869b-d0d94429fe68 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:39.736602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.781968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c1aeb-b560-473c-b05d-2f0cd7c4e1fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:39.782891 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c1aeb-b560-473c-b05d-2f0cd7c4e1fc service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.783171 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c1aeb-b560-473c-b05d-2f0cd7c4e1fc service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.783587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c1aeb-b560-473c-b05d-2f0cd7c4e1fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.785982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8a5c1aeb-b560-473c-b05d-2f0cd7c4e1fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:39.889156 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c1aeb-b560-473c-b05d-2f0cd7c4e1fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:39.891360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c1aeb-b560-473c-b05d-2f0cd7c4e1fc service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:39.912440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 680/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:42.087421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde9de5-b3c9-45b7-8789-39c0e5f9c12b None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.088087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde9de5-b3c9-45b7-8789-39c0e5f9c12b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.088087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde9de5-b3c9-45b7-8789-39c0e5f9c12b None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.092915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 681/1361] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:42.094937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46109-c2f8-4cfd-bd06-f777a95e214e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.095511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46109-c2f8-4cfd-bd06-f777a95e214e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.095511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46109-c2f8-4cfd-bd06-f777a95e214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.174238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-bcb46109-c2f8-4cfd-bd06-f777a95e214e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:42.175384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bcb46109-c2f8-4cfd-bd06-f777a95e214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:42.218436 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:42.281771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 681/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:42.575495 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde9de5-b3c9-45b7-8789-39c0e5f9c12b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:42.577042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-bbde9de5-b3c9-45b7-8789-39c0e5f9c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:42.644983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:42.734166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde9de5-b3c9-45b7-8789-39c0e5f9c12b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:42.870510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64111be5-2f1c-47af-955f-596697d3e0ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:42.871648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64111be5-2f1c-47af-955f-596697d3e0ae service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.872153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64111be5-2f1c-47af-955f-596697d3e0ae service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.872684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64111be5-2f1c-47af-955f-596697d3e0ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.874629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-64111be5-2f1c-47af-955f-596697d3e0ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:42.902755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:42.999431 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64111be5-2f1c-47af-955f-596697d3e0ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:43.001565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64111be5-2f1c-47af-955f-596697d3e0ae service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:43.024375 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 682/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:45.578072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a9155-2e3d-4188-9a3a-75a0f031d80a None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.578989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a9155-2e3d-4188-9a3a-75a0f031d80a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.579504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a9155-2e3d-4188-9a3a-75a0f031d80a None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.581634 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 682/1364] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:45.587258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935cb7e-d5de-405f-9d66-ad33513970e2 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.588014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935cb7e-d5de-405f-9d66-ad33513970e2 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.588474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935cb7e-d5de-405f-9d66-ad33513970e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.667659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-9935cb7e-d5de-405f-9d66-ad33513970e2 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:45.670266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9935cb7e-d5de-405f-9d66-ad33513970e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:45.847133 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:45.856789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 683/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:46.405544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad110-0794-470e-8d21-454631e7c987 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.405917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad110-0794-470e-8d21-454631e7c987 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.406356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad110-0794-470e-8d21-454631e7c987 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.408168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 683/1366] 10.222.0.18 () {54 vars in 962 bytes} [Mon Aug 22 15:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:49:46.414767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d223ff2-b01e-4733-b433-22957b9b9156 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.415059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d223ff2-b01e-4733-b433-22957b9b9156 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.415337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d223ff2-b01e-4733-b433-22957b9b9156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.510119 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-8d223ff2-b01e-4733-b433-22957b9b9156 None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:46.511756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8d223ff2-b01e-4733-b433-22957b9b9156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:46.659688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 684/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Aug 22 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:46.663761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdad110-0794-470e-8d21-454631e7c987 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:46.665329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9bdad110-0794-470e-8d21-454631e7c987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:46.825286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdad110-0794-470e-8d21-454631e7c987 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:46.848484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:46.950169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aea0b-604c-4136-bbff-26dc2d078944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:46.950702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aea0b-604c-4136-bbff-26dc2d078944 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.950985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aea0b-604c-4136-bbff-26dc2d078944 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.951263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aea0b-604c-4136-bbff-26dc2d078944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.952974 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fb4aea0b-604c-4136-bbff-26dc2d078944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:47.058368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aea0b-604c-4136-bbff-26dc2d078944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:47.059997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4aea0b-604c-4136-bbff-26dc2d078944 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:47.081918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 684/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:49:47.207894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9311765-fc9e-4713-a513-19279fe5f574 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:47.208226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9311765-fc9e-4713-a513-19279fe5f574 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:47.208620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9311765-fc9e-4713-a513-19279fe5f574 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:47.210133 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 685/1369] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:47.216142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df943319-3c01-44d6-9a76-7ad01c65acbe None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:47.216457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df943319-3c01-44d6-9a76-7ad01c65acbe None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:47.216782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df943319-3c01-44d6-9a76-7ad01c65acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:47.249746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:47.296367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-df943319-3c01-44d6-9a76-7ad01c65acbe None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:47.297691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-df943319-3c01-44d6-9a76-7ad01c65acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:47.410217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 685/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:48.013415 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415aa14-422a-4ff9-9f92-6da13bc9b94f None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.013415 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415aa14-422a-4ff9-9f92-6da13bc9b94f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.013415 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415aa14-422a-4ff9-9f92-6da13bc9b94f None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.016971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 686/1371] 10.222.0.18 () {54 vars in 964 bytes} [Mon Aug 22 15:49:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:48.017538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431462e0-fd60-4e01-8db4-a05eaeed9ba9 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.018074 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431462e0-fd60-4e01-8db4-a05eaeed9ba9 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.018260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431462e0-fd60-4e01-8db4-a05eaeed9ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.118564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-431462e0-fd60-4e01-8db4-a05eaeed9ba9 None None] MFA Rules not processed for user `d8d073f3152f4825becf78c24539477e`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:48.119945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-431462e0-fd60-4e01-8db4-a05eaeed9ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:48.175990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:48.210695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 686/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Aug 22 15:49:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:48.220253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415aa14-422a-4ff9-9f92-6da13bc9b94f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:48.222393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3415aa14-422a-4ff9-9f92-6da13bc9b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:48.281169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:48.346575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415aa14-422a-4ff9-9f92-6da13bc9b94f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:48.427750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2af480-6466-4015-86ad-9921a7dfdd52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:48.428437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af480-6466-4015-86ad-9921a7dfdd52 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.428764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af480-6466-4015-86ad-9921a7dfdd52 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.429166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af480-6466-4015-86ad-9921a7dfdd52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.431803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fd2af480-6466-4015-86ad-9921a7dfdd52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:48.560130 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:48.577208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2af480-6466-4015-86ad-9921a7dfdd52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:48.579168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2af480-6466-4015-86ad-9921a7dfdd52 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:48.603024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 687/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:49.380228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679368e9-cb4c-4f00-8000-970ead35849d None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:49.380827 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679368e9-cb4c-4f00-8000-970ead35849d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:49.380827 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679368e9-cb4c-4f00-8000-970ead35849d None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:49.382143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 687/1374] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:49.387368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e9359-28b9-48ff-9f10-93779da63428 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:49.387967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e9359-28b9-48ff-9f10-93779da63428 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:49.388081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e9359-28b9-48ff-9f10-93779da63428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:49.455925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-dc5e9359-28b9-48ff-9f10-93779da63428 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:49.457185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-dc5e9359-28b9-48ff-9f10-93779da63428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:49.557774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 688/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:49.846976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679368e9-cb4c-4f00-8000-970ead35849d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:49.848493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-679368e9-cb4c-4f00-8000-970ead35849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:49.998717 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679368e9-cb4c-4f00-8000-970ead35849d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:50.052459 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:50.118498 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8e324-4078-4059-809c-2e2d33594ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:50.119148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8e324-4078-4059-809c-2e2d33594ad4 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:50.119831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8e324-4078-4059-809c-2e2d33594ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:50.120053 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8e324-4078-4059-809c-2e2d33594ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:50.122502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-30d8e324-4078-4059-809c-2e2d33594ad4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:50.214300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8e324-4078-4059-809c-2e2d33594ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:50.216007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8e324-4078-4059-809c-2e2d33594ad4 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:50.234838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 688/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:52.395460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21368b-0dcb-473d-8811-df4b8dd826cd None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.396034 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21368b-0dcb-473d-8811-df4b8dd826cd None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.396034 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21368b-0dcb-473d-8811-df4b8dd826cd None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.397383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 689/1377] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:52.403779 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512250e8-c2db-46ea-a5dc-9710606da533 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.403779 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512250e8-c2db-46ea-a5dc-9710606da533 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.403779 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512250e8-c2db-46ea-a5dc-9710606da533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.501580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-512250e8-c2db-46ea-a5dc-9710606da533 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:52.502820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-512250e8-c2db-46ea-a5dc-9710606da533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:52.510932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:52.624844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 689/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:52.913730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21368b-0dcb-473d-8811-df4b8dd826cd None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:52.915469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3e21368b-0dcb-473d-8811-df4b8dd826cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:52.993613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:53.094548 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21368b-0dcb-473d-8811-df4b8dd826cd None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:53.229247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4e555-9e76-4df8-9a1e-841f0c477241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:53.230092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4e555-9e76-4df8-9a1e-841f0c477241 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:53.230629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4e555-9e76-4df8-9a1e-841f0c477241 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:53.231055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4e555-9e76-4df8-9a1e-841f0c477241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:53.233103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3ef4e555-9e76-4df8-9a1e-841f0c477241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:53.255253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:53.338874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4e555-9e76-4df8-9a1e-841f0c477241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:53.340662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4e555-9e76-4df8-9a1e-841f0c477241 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:53.360542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 690/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:55.610344 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dec371-bcf8-40bb-bb0d-0eefa03a871e None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:55.610918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dec371-bcf8-40bb-bb0d-0eefa03a871e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:55.610918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dec371-bcf8-40bb-bb0d-0eefa03a871e None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:55.612969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 690/1380] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:55.618867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c18f-e8c9-49f4-a7c1-d4007406a1a0 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:55.619806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c18f-e8c9-49f4-a7c1-d4007406a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:55.620306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c18f-e8c9-49f4-a7c1-d4007406a1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:55.702043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3814c18f-e8c9-49f4-a7c1-d4007406a1a0 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:55.703557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3814c18f-e8c9-49f4-a7c1-d4007406a1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:55.815185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:55.821950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 691/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:49:56.122388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dec371-bcf8-40bb-bb0d-0eefa03a871e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:56.123993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-67dec371-bcf8-40bb-bb0d-0eefa03a871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:56.273252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:56.283450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dec371-bcf8-40bb-bb0d-0eefa03a871e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:56.398419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23037d51-bcc8-4843-bec2-de3abd9c17dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:56.399025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23037d51-bcc8-4843-bec2-de3abd9c17dd service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:56.399305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23037d51-bcc8-4843-bec2-de3abd9c17dd service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:56.399576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23037d51-bcc8-4843-bec2-de3abd9c17dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:56.401201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-23037d51-bcc8-4843-bec2-de3abd9c17dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:56.494658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23037d51-bcc8-4843-bec2-de3abd9c17dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:56.496295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23037d51-bcc8-4843-bec2-de3abd9c17dd service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:56.508104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:56.516802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 691/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:49:59.288066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f16fe-604b-4456-89df-ec5fbfbc92e4 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.288741 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f16fe-604b-4456-89df-ec5fbfbc92e4 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.288883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f16fe-604b-4456-89df-ec5fbfbc92e4 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.290659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 692/1383] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:59.299136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b7376-3ab5-4d22-96cc-ddc55c7e26eb None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.299672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b7376-3ab5-4d22-96cc-ddc55c7e26eb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.299806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b7376-3ab5-4d22-96cc-ddc55c7e26eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.380362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8f1b7376-3ab5-4d22-96cc-ddc55c7e26eb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:59.381661 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8f1b7376-3ab5-4d22-96cc-ddc55c7e26eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:59.500564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 692/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:49:59.874894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f16fe-604b-4456-89df-ec5fbfbc92e4 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.876966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-982f16fe-604b-4456-89df-ec5fbfbc92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:00.057699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f16fe-604b-4456-89df-ec5fbfbc92e4 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.148384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:00.202548 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aee9f5-a77b-4f6a-a067-57030ba7283e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.203167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee9f5-a77b-4f6a-a067-57030ba7283e service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.203444 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee9f5-a77b-4f6a-a067-57030ba7283e service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.203718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aee9f5-a77b-4f6a-a067-57030ba7283e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.205901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-01aee9f5-a77b-4f6a-a067-57030ba7283e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:00.308823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee9f5-a77b-4f6a-a067-57030ba7283e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.310980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aee9f5-a77b-4f6a-a067-57030ba7283e service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.338958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 693/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:02.359844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973563-a09f-4afd-bd00-45e929044e20 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:02.360468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973563-a09f-4afd-bd00-45e929044e20 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:02.360468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a973563-a09f-4afd-bd00-45e929044e20 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:02.361959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 693/1386] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:02.367556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41af616-3721-462b-878b-e0237e93423d None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:02.368101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41af616-3721-462b-878b-e0237e93423d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:02.368101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41af616-3721-462b-878b-e0237e93423d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:02.445049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d41af616-3721-462b-878b-e0237e93423d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:02.446344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d41af616-3721-462b-878b-e0237e93423d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:02.480625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:02.547546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 694/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:02.839247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a973563-a09f-4afd-bd00-45e929044e20 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:02.840865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3a973563-a09f-4afd-bd00-45e929044e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:02.926793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:03.010030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a973563-a09f-4afd-bd00-45e929044e20 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:03.147854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4f737-bddc-42f2-8ebb-fa2b9be24bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:03.148452 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4f737-bddc-42f2-8ebb-fa2b9be24bbc service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:03.148821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4f737-bddc-42f2-8ebb-fa2b9be24bbc service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:03.149162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4f737-bddc-42f2-8ebb-fa2b9be24bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:03.151209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-93c4f737-bddc-42f2-8ebb-fa2b9be24bbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:03.198730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:03.259420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4f737-bddc-42f2-8ebb-fa2b9be24bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:03.261601 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4f737-bddc-42f2-8ebb-fa2b9be24bbc service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:03.283946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 694/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:05.460280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a681c96-5e50-494e-adcc-527e674f9e20 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.460884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a681c96-5e50-494e-adcc-527e674f9e20 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.460884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a681c96-5e50-494e-adcc-527e674f9e20 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.462394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 695/1389] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:05.467604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c0dff-3678-4e32-bf06-d330da01d5dd None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.468099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c0dff-3678-4e32-bf06-d330da01d5dd None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.468212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c0dff-3678-4e32-bf06-d330da01d5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.484705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e65c3-ed75-492f-9529-1d3e7ae67847 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.485021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e65c3-ed75-492f-9529-1d3e7ae67847 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.485268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e65c3-ed75-492f-9529-1d3e7ae67847 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.486960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 696/1390] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:05.492237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebb3bb-5ed2-4d95-810e-3b90073b3271 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.492535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebb3bb-5ed2-4d95-810e-3b90073b3271 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.492847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebb3bb-5ed2-4d95-810e-3b90073b3271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.538281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ef8c0dff-3678-4e32-bf06-d330da01d5dd None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:05.539542 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ef8c0dff-3678-4e32-bf06-d330da01d5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:05.564081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-a0ebb3bb-5ed2-4d95-810e-3b90073b3271 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:05.565233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a0ebb3bb-5ed2-4d95-810e-3b90073b3271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:05.643847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 695/1391] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:05.668699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 697/1392] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:50:05.952836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd772-b089-4521-86a6-0bf8bb20eb2e None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.953122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd772-b089-4521-86a6-0bf8bb20eb2e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.953399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd772-b089-4521-86a6-0bf8bb20eb2e None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.955354 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 696/1393] 10.222.0.18 () {54 vars in 967 bytes} [Mon Aug 22 15:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:05.960037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd772-b089-4521-86a6-0bf8bb20eb2e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:05.960570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d923a3c-f786-48f1-b1ca-1ac59dc58211 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.960868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d923a3c-f786-48f1-b1ca-1ac59dc58211 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.961146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d923a3c-f786-48f1-b1ca-1ac59dc58211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.962154 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b26bd772-b089-4521-86a6-0bf8bb20eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:05.976697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:05.978039 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:06.040504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4d923a3c-f786-48f1-b1ca-1ac59dc58211 None None] MFA Rules not processed for user `c2de83ba29194578a9a229d5bab6612e`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:06.041750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4d923a3c-f786-48f1-b1ca-1ac59dc58211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:06.119248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd772-b089-4521-86a6-0bf8bb20eb2e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:06.123938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 698/1394] 10.222.0.18 () {58 vars in 1064 bytes} [Mon Aug 22 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:06.132136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d923a3c-f786-48f1-b1ca-1ac59dc58211 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:06.139836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d923a3c-f786-48f1-b1ca-1ac59dc58211 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:06.217864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:06.222779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0fa29-db38-4c7c-88aa-4905381aa159 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2de83ba29194578a9a229d5bab6612e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:06.223323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0fa29-db38-4c7c-88aa-4905381aa159 service glance] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:06.223596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0fa29-db38-4c7c-88aa-4905381aa159 service glance] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:06.223861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0fa29-db38-4c7c-88aa-4905381aa159 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:06.225529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-24d0fa29-db38-4c7c-88aa-4905381aa159 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:06.245639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341df4d-d437-4c3d-a0c1-dc076b77b011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:06.246246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341df4d-d437-4c3d-a0c1-dc076b77b011 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:06.246553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341df4d-d437-4c3d-a0c1-dc076b77b011 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:06.246948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341df4d-d437-4c3d-a0c1-dc076b77b011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:06.248635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9341df4d-d437-4c3d-a0c1-dc076b77b011 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:06.257284 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:06.345285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0fa29-db38-4c7c-88aa-4905381aa159 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:06.345548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341df4d-d437-4c3d-a0c1-dc076b77b011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:06.346725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0fa29-db38-4c7c-88aa-4905381aa159 service glance] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:06.346903 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341df4d-d437-4c3d-a0c1-dc076b77b011 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:06.367586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 699/1395] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:50:06.368428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 697/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:07.356263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5eba2-4309-4a7f-88bf-7cd99acb5f75 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:07.356840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5eba2-4309-4a7f-88bf-7cd99acb5f75 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:07.357093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5eba2-4309-4a7f-88bf-7cd99acb5f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:07.428118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-06a5eba2-4309-4a7f-88bf-7cd99acb5f75 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:07.429395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-06a5eba2-4309-4a7f-88bf-7cd99acb5f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:07.520926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:07.527030 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 700/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 15:50:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:07.572476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b91c9-4bec-4608-8967-d037add73ee3 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:07.573022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b91c9-4bec-4608-8967-d037add73ee3 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:07.573148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b91c9-4bec-4608-8967-d037add73ee3 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:07.574379 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 698/1398] 10.222.0.18 () {54 vars in 943 bytes} [Mon Aug 22 15:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:07.580840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a8084-822f-47af-8998-cdc7932c775e None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:07.588499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a8084-822f-47af-8998-cdc7932c775e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:07.588499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a8084-822f-47af-8998-cdc7932c775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:07.667197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b57a8084-822f-47af-8998-cdc7932c775e None None] MFA Rules not processed for user `92bc91b8b5224bd18f79bd8ea4663d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:07.668651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b57a8084-822f-47af-8998-cdc7932c775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:07.786818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 701/1399] 10.222.0.18 () {58 vars in 1040 bytes} [Mon Aug 22 15:50:07 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:50:07.796566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b91c9-4bec-4608-8967-d037add73ee3 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:07.798167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-020b91c9-4bec-4608-8967-d037add73ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:07.900069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:07.944983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b91c9-4bec-4608-8967-d037add73ee3 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:08.058993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7384-8312-4dbe-a61e-cb83669cc622 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:08.059609 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7384-8312-4dbe-a61e-cb83669cc622 service swift] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:08.059881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7384-8312-4dbe-a61e-cb83669cc622 service swift] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:08.060147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7384-8312-4dbe-a61e-cb83669cc622 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:08.061830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b45d7384-8312-4dbe-a61e-cb83669cc622 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:08.155480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d7384-8312-4dbe-a61e-cb83669cc622 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:08.158070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d7384-8312-4dbe-a61e-cb83669cc622 service swift] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:08.162294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:08.167651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 699/1400] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 15:50:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 15:50:08.608052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787aab5-cdd2-40fb-8fd7-f3f0bf3d4e10 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:08.608672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787aab5-cdd2-40fb-8fd7-f3f0bf3d4e10 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:08.608672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787aab5-cdd2-40fb-8fd7-f3f0bf3d4e10 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:08.610148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 702/1401] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:08.616087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef93f4-f845-43c4-8c44-df4fd1b65446 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:08.616672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef93f4-f845-43c4-8c44-df4fd1b65446 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:08.616672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef93f4-f845-43c4-8c44-df4fd1b65446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:08.686464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c3ef93f4-f845-43c4-8c44-df4fd1b65446 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:08.687712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c3ef93f4-f845-43c4-8c44-df4fd1b65446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:08.787943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 700/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:09.089253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787aab5-cdd2-40fb-8fd7-f3f0bf3d4e10 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:09.089253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6787aab5-cdd2-40fb-8fd7-f3f0bf3d4e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:09.149991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:09.255340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787aab5-cdd2-40fb-8fd7-f3f0bf3d4e10 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:09.397011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33683fb5-19e4-458a-8f6a-f9467f965403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:09.397753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33683fb5-19e4-458a-8f6a-f9467f965403 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:09.398229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33683fb5-19e4-458a-8f6a-f9467f965403 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:09.398600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33683fb5-19e4-458a-8f6a-f9467f965403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:09.400330 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-33683fb5-19e4-458a-8f6a-f9467f965403 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:09.421585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:09.551782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33683fb5-19e4-458a-8f6a-f9467f965403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:09.551782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33683fb5-19e4-458a-8f6a-f9467f965403 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:09.551782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 703/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:12.974088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea4acb-0f2a-4b93-b410-b8f467ca6f93 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:12.974691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea4acb-0f2a-4b93-b410-b8f467ca6f93 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:12.974691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea4acb-0f2a-4b93-b410-b8f467ca6f93 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:12.976092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 701/1404] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:12.982528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7322a73-42de-40ee-b5a2-844d68749c71 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:12.983040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7322a73-42de-40ee-b5a2-844d68749c71 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:12.983151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7322a73-42de-40ee-b5a2-844d68749c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:13.074938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c7322a73-42de-40ee-b5a2-844d68749c71 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:13.076221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c7322a73-42de-40ee-b5a2-844d68749c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:13.196409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:13.209596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 704/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:13.510530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea4acb-0f2a-4b93-b410-b8f467ca6f93 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:13.513206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-90ea4acb-0f2a-4b93-b410-b8f467ca6f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:13.620617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:13.732274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea4acb-0f2a-4b93-b410-b8f467ca6f93 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:13.872408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe97870-a30e-467f-aab4-120bffa64916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:13.875393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe97870-a30e-467f-aab4-120bffa64916 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:13.875805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe97870-a30e-467f-aab4-120bffa64916 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:13.876084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe97870-a30e-467f-aab4-120bffa64916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:13.877881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7fe97870-a30e-467f-aab4-120bffa64916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:13.929596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:13.990447 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe97870-a30e-467f-aab4-120bffa64916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:13.992048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe97870-a30e-467f-aab4-120bffa64916 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:14.013091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 702/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:50:16.297844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c744e9-90b8-4d50-a30b-15cab608e5e5 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:16.298445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c744e9-90b8-4d50-a30b-15cab608e5e5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:16.298445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c744e9-90b8-4d50-a30b-15cab608e5e5 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:16.299720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 705/1407] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:16.305450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466770b-ca79-4035-b894-5a28e30dd6d3 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:16.305953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466770b-ca79-4035-b894-5a28e30dd6d3 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:16.306043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466770b-ca79-4035-b894-5a28e30dd6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:16.388557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-6466770b-ca79-4035-b894-5a28e30dd6d3 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:16.389780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6466770b-ca79-4035-b894-5a28e30dd6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:16.516263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 703/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:16.830721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c744e9-90b8-4d50-a30b-15cab608e5e5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:16.832886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f7c744e9-90b8-4d50-a30b-15cab608e5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:17.010112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c744e9-90b8-4d50-a30b-15cab608e5e5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:17.098440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:17.152086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aefd0c-e972-40b9-a41a-52babf06e0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:17.152730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aefd0c-e972-40b9-a41a-52babf06e0f4 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:17.153011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aefd0c-e972-40b9-a41a-52babf06e0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:17.153281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aefd0c-e972-40b9-a41a-52babf06e0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:17.154899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-01aefd0c-e972-40b9-a41a-52babf06e0f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:17.263860 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aefd0c-e972-40b9-a41a-52babf06e0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:17.265643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aefd0c-e972-40b9-a41a-52babf06e0f4 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:17.286797 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 706/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:26.514100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=93 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:27.295420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=65 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:33.108902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8f050-fd63-4b9d-8673-b89aef374dd6 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:33.110438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8f050-fd63-4b9d-8673-b89aef374dd6 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:33.110704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8f050-fd63-4b9d-8673-b89aef374dd6 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:33.112063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 704/1410] 10.222.0.18 () {54 vars in 918 bytes} [Mon Aug 22 15:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:33.118122 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9e40-986d-4535-913e-e6a9f78517d5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:33.118602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9e40-986d-4535-913e-e6a9f78517d5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:33.118775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a9e40-986d-4535-913e-e6a9f78517d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:33.195521 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-bf8a9e40-986d-4535-913e-e6a9f78517d5 None None] MFA Rules not processed for user `9ecb4e7e9e3042adadd93229f8456eca`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:33.196825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-bf8a9e40-986d-4535-913e-e6a9f78517d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:33.307730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 707/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Aug 22 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:33.322959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92088b2-0824-47bb-aff3-8a82f19fb565 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:33.323239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92088b2-0824-47bb-aff3-8a82f19fb565 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:33.323516 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92088b2-0824-47bb-aff3-8a82f19fb565 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:33.325443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 705/1412] 10.222.0.18 () {54 vars in 918 bytes} [Mon Aug 22 15:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:33.329926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aabe2b-3f1b-4445-9467-6ddc27a39882 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:33.330215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aabe2b-3f1b-4445-9467-6ddc27a39882 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:33.330488 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aabe2b-3f1b-4445-9467-6ddc27a39882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:33.406921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:33.409663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-54aabe2b-3f1b-4445-9467-6ddc27a39882 None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:33.410882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-54aabe2b-3f1b-4445-9467-6ddc27a39882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:33.527910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 708/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Aug 22 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:35.968197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606cb80-bdd9-427e-adcf-5e6a16b93d57 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:35.968197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606cb80-bdd9-427e-adcf-5e6a16b93d57 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:35.968854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606cb80-bdd9-427e-adcf-5e6a16b93d57 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:35.969774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:35.975905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1bb81-1096-4048-94ca-c6337888c133 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:35.976484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1bb81-1096-4048-94ca-c6337888c133 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:35.976484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1bb81-1096-4048-94ca-c6337888c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:36.045555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-22a1bb81-1096-4048-94ca-c6337888c133 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:36.046768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-22a1bb81-1096-4048-94ca-c6337888c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:36.106639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:36.149639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:36.445191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606cb80-bdd9-427e-adcf-5e6a16b93d57 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:36.446735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8606cb80-bdd9-427e-adcf-5e6a16b93d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:36.611577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606cb80-bdd9-427e-adcf-5e6a16b93d57 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:36.701094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:36.748783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adc53b-1ba6-4984-b5d6-d92b4cab0f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:36.749446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adc53b-1ba6-4984-b5d6-d92b4cab0f58 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:36.750241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adc53b-1ba6-4984-b5d6-d92b4cab0f58 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:36.750511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adc53b-1ba6-4984-b5d6-d92b4cab0f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:36.752424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-70adc53b-1ba6-4984-b5d6-d92b4cab0f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:36.853544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adc53b-1ba6-4984-b5d6-d92b4cab0f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:36.855185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adc53b-1ba6-4984-b5d6-d92b4cab0f58 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:36.875430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 707/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:37.780666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c1a3e-3fe0-4bd2-ba67-ace1abe4ee58 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:37.781856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c1a3e-3fe0-4bd2-ba67-ace1abe4ee58 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:37.781990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c1a3e-3fe0-4bd2-ba67-ace1abe4ee58 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:37.783359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:37.788805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f478201-5205-4290-99d7-2ee17171c7ad None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:37.789231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f478201-5205-4290-99d7-2ee17171c7ad None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:37.789358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f478201-5205-4290-99d7-2ee17171c7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:37.869623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4f478201-5205-4290-99d7-2ee17171c7ad None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:37.870986 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4f478201-5205-4290-99d7-2ee17171c7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:37.900662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:37.974892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:38.127530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c1a3e-3fe0-4bd2-ba67-ace1abe4ee58 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:38.129064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-918c1a3e-3fe0-4bd2-ba67-ace1abe4ee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:38.284337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c1a3e-3fe0-4bd2-ba67-ace1abe4ee58 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:38.326242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:38.403492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08657474-754b-487a-9b00-52336a726313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:38.404029 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08657474-754b-487a-9b00-52336a726313 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:38.404309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08657474-754b-487a-9b00-52336a726313 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:38.404619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08657474-754b-487a-9b00-52336a726313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:38.406577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-08657474-754b-487a-9b00-52336a726313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:38.511103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08657474-754b-487a-9b00-52336a726313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:38.512766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08657474-754b-487a-9b00-52336a726313 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:38.533630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 711/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:39.444811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade497-24fd-41a4-8b00-bae2373bccf8 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:39.445397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade497-24fd-41a4-8b00-bae2373bccf8 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:39.445397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdade497-24fd-41a4-8b00-bae2373bccf8 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:39.446726 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:39.451978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfd445-3127-4d4c-9781-a2583bea0c59 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:39.452448 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfd445-3127-4d4c-9781-a2583bea0c59 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:39.453109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfd445-3127-4d4c-9781-a2583bea0c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:39.508400 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:39.530189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-46dfd445-3127-4d4c-9781-a2583bea0c59 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:39.531405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-46dfd445-3127-4d4c-9781-a2583bea0c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:39.628934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:39.783026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdade497-24fd-41a4-8b00-bae2373bccf8 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:39.784731 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-cdade497-24fd-41a4-8b00-bae2373bccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:39.932978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdade497-24fd-41a4-8b00-bae2373bccf8 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:39.946723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:40.049878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04596fbf-aa97-4242-b8a4-5d0130728724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:40.050486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596fbf-aa97-4242-b8a4-5d0130728724 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:40.050763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596fbf-aa97-4242-b8a4-5d0130728724 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:40.051030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596fbf-aa97-4242-b8a4-5d0130728724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:40.052676 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-04596fbf-aa97-4242-b8a4-5d0130728724 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:40.145299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04596fbf-aa97-4242-b8a4-5d0130728724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:40.146884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04596fbf-aa97-4242-b8a4-5d0130728724 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:40.165559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 710/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:41.042582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb2035-8ae5-4558-9aa6-77362cfd725e None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.043142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb2035-8ae5-4558-9aa6-77362cfd725e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.043142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb2035-8ae5-4558-9aa6-77362cfd725e None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.044470 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:41.050249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac44c-ceaa-4a46-b124-1e42fe52808f None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.050697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac44c-ceaa-4a46-b124-1e42fe52808f None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.050794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac44c-ceaa-4a46-b124-1e42fe52808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.070873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:41.129583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-974ac44c-ceaa-4a46-b124-1e42fe52808f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:41.130801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-974ac44c-ceaa-4a46-b124-1e42fe52808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:41.229293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:50:41.383848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb2035-8ae5-4558-9aa6-77362cfd725e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:41.385584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-24bb2035-8ae5-4558-9aa6-77362cfd725e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:41.497005 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:41.533715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb2035-8ae5-4558-9aa6-77362cfd725e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:41.647528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3427e2e-00c7-4748-9af0-bd424790f627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:41.648134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427e2e-00c7-4748-9af0-bd424790f627 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.648407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427e2e-00c7-4748-9af0-bd424790f627 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.648706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427e2e-00c7-4748-9af0-bd424790f627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.650299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f3427e2e-00c7-4748-9af0-bd424790f627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:41.727930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:41.741033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3427e2e-00c7-4748-9af0-bd424790f627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:41.742611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3427e2e-00c7-4748-9af0-bd424790f627 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:41.761601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 714/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:42.665999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05881c-5ca1-4a45-8dbf-129d513388a0 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.666630 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05881c-5ca1-4a45-8dbf-129d513388a0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.666630 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05881c-5ca1-4a45-8dbf-129d513388a0 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.667943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:42.673630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02cde5-8bca-458c-8181-fba568a04f6c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.674055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02cde5-8bca-458c-8181-fba568a04f6c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.674158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02cde5-8bca-458c-8181-fba568a04f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.750814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-2f02cde5-8bca-458c-8181-fba568a04f6c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:42.752066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2f02cde5-8bca-458c-8181-fba568a04f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:42.851499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:43.008815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05881c-5ca1-4a45-8dbf-129d513388a0 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:43.010364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ec05881c-5ca1-4a45-8dbf-129d513388a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:43.096089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:43.158449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05881c-5ca1-4a45-8dbf-129d513388a0 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:43.273124 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de58767-fb23-4122-81e1-806cb8a94409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:43.273732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de58767-fb23-4122-81e1-806cb8a94409 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:43.274007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de58767-fb23-4122-81e1-806cb8a94409 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:43.274282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de58767-fb23-4122-81e1-806cb8a94409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:43.275866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5de58767-fb23-4122-81e1-806cb8a94409 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:43.324209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:43.369349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de58767-fb23-4122-81e1-806cb8a94409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:43.371045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de58767-fb23-4122-81e1-806cb8a94409 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:43.390859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 713/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:44.426925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdcf12-019b-4f0d-93a9-1688bebbd49b None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:44.427508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdcf12-019b-4f0d-93a9-1688bebbd49b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:44.427508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdcf12-019b-4f0d-93a9-1688bebbd49b None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:44.428840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:44.434289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388fc3f-c09a-4cd9-93b7-4dead397c428 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:44.434704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388fc3f-c09a-4cd9-93b7-4dead397c428 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:44.434875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388fc3f-c09a-4cd9-93b7-4dead397c428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:44.512570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-1388fc3f-c09a-4cd9-93b7-4dead397c428 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:44.513831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1388fc3f-c09a-4cd9-93b7-4dead397c428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:44.613008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:44.767086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdcf12-019b-4f0d-93a9-1688bebbd49b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:44.768659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1dfdcf12-019b-4f0d-93a9-1688bebbd49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:44.817992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:44.919264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdcf12-019b-4f0d-93a9-1688bebbd49b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:45.042055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b446e07-d215-4015-afba-ceccb70ea443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:45.042630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446e07-d215-4015-afba-ceccb70ea443 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:45.042926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446e07-d215-4015-afba-ceccb70ea443 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:45.043197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b446e07-d215-4015-afba-ceccb70ea443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:45.044943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7b446e07-d215-4015-afba-ceccb70ea443 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:45.052926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:45.136934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b446e07-d215-4015-afba-ceccb70ea443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:45.138615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b446e07-d215-4015-afba-ceccb70ea443 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:45.158528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 717/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:46.069990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb3533-0c64-4659-9fc4-14d3d6e0799c None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.070540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb3533-0c64-4659-9fc4-14d3d6e0799c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.070540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb3533-0c64-4659-9fc4-14d3d6e0799c None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.071888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:46.076927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ecd00-6bc2-4216-acea-1ba2fd1eead5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.077364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ecd00-6bc2-4216-acea-1ba2fd1eead5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.077466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ecd00-6bc2-4216-acea-1ba2fd1eead5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.153625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c13ecd00-6bc2-4216-acea-1ba2fd1eead5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:46.154827 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c13ecd00-6bc2-4216-acea-1ba2fd1eead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:46.224936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.255315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:46.403628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb3533-0c64-4659-9fc4-14d3d6e0799c None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:46.405168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7deb3533-0c64-4659-9fc4-14d3d6e0799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:46.425431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.556078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb3533-0c64-4659-9fc4-14d3d6e0799c None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.643129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.670509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42776876-1a6d-4a64-8e85-7694d539352e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.671119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42776876-1a6d-4a64-8e85-7694d539352e service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.671397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42776876-1a6d-4a64-8e85-7694d539352e service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.671669 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42776876-1a6d-4a64-8e85-7694d539352e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.673328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-42776876-1a6d-4a64-8e85-7694d539352e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:46.765395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42776876-1a6d-4a64-8e85-7694d539352e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:46.767001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42776876-1a6d-4a64-8e85-7694d539352e service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:46.785265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 716/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:47.682507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eeddb-2c5d-4546-b055-01d2f2fd4f05 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:47.683042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eeddb-2c5d-4546-b055-01d2f2fd4f05 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:47.683042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eeddb-2c5d-4546-b055-01d2f2fd4f05 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:47.684395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:47.690352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f488-2e7b-4741-b643-6d243c13213f None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:47.690802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f488-2e7b-4741-b643-6d243c13213f None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:47.690915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f488-2e7b-4741-b643-6d243c13213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:47.766957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3d61f488-2e7b-4741-b643-6d243c13213f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:47.768397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3d61f488-2e7b-4741-b643-6d243c13213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:47.812932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:47.868502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:48.019143 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eeddb-2c5d-4546-b055-01d2f2fd4f05 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:48.020703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c39eeddb-2c5d-4546-b055-01d2f2fd4f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:48.167200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eeddb-2c5d-4546-b055-01d2f2fd4f05 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:48.222438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:48.280287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb13b8-01a5-4fb2-af7b-2d113fef37bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:48.281712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb13b8-01a5-4fb2-af7b-2d113fef37bc service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:48.282097 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb13b8-01a5-4fb2-af7b-2d113fef37bc service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:48.282370 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb13b8-01a5-4fb2-af7b-2d113fef37bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:48.283976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-86fb13b8-01a5-4fb2-af7b-2d113fef37bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:48.381273 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb13b8-01a5-4fb2-af7b-2d113fef37bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:48.382925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb13b8-01a5-4fb2-af7b-2d113fef37bc service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:48.401064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 720/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:49.296591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040023e-2dfc-4aa3-a779-953a49d13f2b None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:49.297113 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040023e-2dfc-4aa3-a779-953a49d13f2b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:49.297113 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040023e-2dfc-4aa3-a779-953a49d13f2b None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:49.298565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:49.303673 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60f882-2a42-4ec4-b9e0-8ed563b5be6b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:49.304068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60f882-2a42-4ec4-b9e0-8ed563b5be6b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:49.304255 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60f882-2a42-4ec4-b9e0-8ed563b5be6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:49.384897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-1e60f882-2a42-4ec4-b9e0-8ed563b5be6b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:49.386195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1e60f882-2a42-4ec4-b9e0-8ed563b5be6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:49.388152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:49.486267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:49.638134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040023e-2dfc-4aa3-a779-953a49d13f2b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:49.640234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4040023e-2dfc-4aa3-a779-953a49d13f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:49.787692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040023e-2dfc-4aa3-a779-953a49d13f2b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:49.815310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:49.907437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5c4da-6ab8-4478-83bb-c6abd1d16314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:49.908040 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c4da-6ab8-4478-83bb-c6abd1d16314 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:49.908362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c4da-6ab8-4478-83bb-c6abd1d16314 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:49.908664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c4da-6ab8-4478-83bb-c6abd1d16314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:49.910265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-91e5c4da-6ab8-4478-83bb-c6abd1d16314 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:50.002966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5c4da-6ab8-4478-83bb-c6abd1d16314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:50.007091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5c4da-6ab8-4478-83bb-c6abd1d16314 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:50.022874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 719/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:51.919830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191bc48-a151-4c9d-b40e-9d6e8e292372 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:51.920371 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191bc48-a151-4c9d-b40e-9d6e8e292372 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:51.920467 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191bc48-a151-4c9d-b40e-9d6e8e292372 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:51.922397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:51.928714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b72c1-bc81-45f4-84cb-f8482aa9af2b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:51.929178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b72c1-bc81-45f4-84cb-f8482aa9af2b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:51.929288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b72c1-bc81-45f4-84cb-f8482aa9af2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:51.972948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:51.998525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7c7b72c1-bc81-45f4-84cb-f8482aa9af2b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:52.000327 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7c7b72c1-bc81-45f4-84cb-f8482aa9af2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:52.095862 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:52.392377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191bc48-a151-4c9d-b40e-9d6e8e292372 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:52.393953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1191bc48-a151-4c9d-b40e-9d6e8e292372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:52.502060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191bc48-a151-4c9d-b40e-9d6e8e292372 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:52.533943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:52.575092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff5648-80f0-4aa1-8ee4-451fd5ae201e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:52.575694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff5648-80f0-4aa1-8ee4-451fd5ae201e service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:52.575972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff5648-80f0-4aa1-8ee4-451fd5ae201e service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:52.576240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff5648-80f0-4aa1-8ee4-451fd5ae201e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:52.578220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b2ff5648-80f0-4aa1-8ee4-451fd5ae201e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:52.685820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff5648-80f0-4aa1-8ee4-451fd5ae201e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:52.687194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff5648-80f0-4aa1-8ee4-451fd5ae201e service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:52.705810 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 723/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:54.783934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750bea-6ee0-4bbf-9f17-b4b5b729505e None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:54.784493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750bea-6ee0-4bbf-9f17-b4b5b729505e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:54.784649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750bea-6ee0-4bbf-9f17-b4b5b729505e None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:54.785898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:54.791301 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df04ebe-527c-44ba-ba7a-efdb8f0cb8e0 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:54.791800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df04ebe-527c-44ba-ba7a-efdb8f0cb8e0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:54.791914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df04ebe-527c-44ba-ba7a-efdb8f0cb8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:54.857166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4df04ebe-527c-44ba-ba7a-efdb8f0cb8e0 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:54.858901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4df04ebe-527c-44ba-ba7a-efdb8f0cb8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:54.871495 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:54.956812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:55.246322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750bea-6ee0-4bbf-9f17-b4b5b729505e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:55.247999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a5750bea-6ee0-4bbf-9f17-b4b5b729505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:55.471308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750bea-6ee0-4bbf-9f17-b4b5b729505e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:55.483584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:55.545172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d09cf-1ca6-4d66-ba9b-66815660b57a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:55.545727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d09cf-1ca6-4d66-ba9b-66815660b57a service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:55.546001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d09cf-1ca6-4d66-ba9b-66815660b57a service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:55.546294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d09cf-1ca6-4d66-ba9b-66815660b57a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:55.547930 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-585d09cf-1ca6-4d66-ba9b-66815660b57a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:55.656726 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d09cf-1ca6-4d66-ba9b-66815660b57a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:55.658162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d09cf-1ca6-4d66-ba9b-66815660b57a service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:55.676319 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 722/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:50:58.037402 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f114129-a41b-4a7e-a38f-2c00564f39fd None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:58.037979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f114129-a41b-4a7e-a38f-2c00564f39fd None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:58.037979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f114129-a41b-4a7e-a38f-2c00564f39fd None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:58.039331 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:58.044847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c108b2-0538-47d2-9622-463b2fc98daf None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:58.045344 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c108b2-0538-47d2-9622-463b2fc98daf None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:58.045478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c108b2-0538-47d2-9622-463b2fc98daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:58.102511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:58.120707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b9c108b2-0538-47d2-9622-463b2fc98daf None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:58.121925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b9c108b2-0538-47d2-9622-463b2fc98daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:58.220835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:50:58.505580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f114129-a41b-4a7e-a38f-2c00564f39fd None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:58.507203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0f114129-a41b-4a7e-a38f-2c00564f39fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:58.614576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f114129-a41b-4a7e-a38f-2c00564f39fd None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:58.655684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:58.690500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996e95-4225-43b0-b477-866f1d909db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:58.691106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996e95-4225-43b0-b477-866f1d909db3 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:58.691385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996e95-4225-43b0-b477-866f1d909db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:58.691669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996e95-4225-43b0-b477-866f1d909db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:58.693747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-78996e95-4225-43b0-b477-866f1d909db3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:58.805874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78996e95-4225-43b0-b477-866f1d909db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:58.807445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78996e95-4225-43b0-b477-866f1d909db3 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:58.827361 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 726/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:00.897079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f48de-ff6a-4886-ac84-fddc95282477 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:00.897623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f48de-ff6a-4886-ac84-fddc95282477 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:00.897623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f48de-ff6a-4886-ac84-fddc95282477 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:00.899054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:51:00.904600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2043a-c805-4f0d-a65d-35e432a48518 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:00.905057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2043a-c805-4f0d-a65d-35e432a48518 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:00.905157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2043a-c805-4f0d-a65d-35e432a48518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:00.974179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d3c2043a-c805-4f0d-a65d-35e432a48518 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:00.975390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d3c2043a-c805-4f0d-a65d-35e432a48518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:00.996356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:01.077013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:51:01.368027 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f48de-ff6a-4886-ac84-fddc95282477 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:01.369719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-511f48de-ff6a-4886-ac84-fddc95282477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:01.473216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f48de-ff6a-4886-ac84-fddc95282477 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:01.493210 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:01.546635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d3a6c-0939-4147-bf9e-28385b321748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:01.547244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3a6c-0939-4147-bf9e-28385b321748 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:01.547522 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3a6c-0939-4147-bf9e-28385b321748 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:01.547791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3a6c-0939-4147-bf9e-28385b321748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:01.549987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2b4d3a6c-0939-4147-bf9e-28385b321748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:01.660631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d3a6c-0939-4147-bf9e-28385b321748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:01.661977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d3a6c-0939-4147-bf9e-28385b321748 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:01.680394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 725/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:03.737227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927832eb-1692-405d-9d65-e4f5c99d35c1 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:03.737798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927832eb-1692-405d-9d65-e4f5c99d35c1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:03.737798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927832eb-1692-405d-9d65-e4f5c99d35c1 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:03.739116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:03.744379 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39788e-6f59-480b-a105-1f24ba9f524c None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:03.744861 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39788e-6f59-480b-a105-1f24ba9f524c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:03.744974 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39788e-6f59-480b-a105-1f24ba9f524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:03.808874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:03.812475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ec39788e-6f59-480b-a105-1f24ba9f524c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:03.813847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ec39788e-6f59-480b-a105-1f24ba9f524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:03.915478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:04.202189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927832eb-1692-405d-9d65-e4f5c99d35c1 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:04.203753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-927832eb-1692-405d-9d65-e4f5c99d35c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:04.310229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927832eb-1692-405d-9d65-e4f5c99d35c1 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:04.478562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:04.503325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88748da2-c7c5-46d9-8d98-803d49432c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:04.503935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748da2-c7c5-46d9-8d98-803d49432c4d service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:04.504211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748da2-c7c5-46d9-8d98-803d49432c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:04.504480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88748da2-c7c5-46d9-8d98-803d49432c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:04.506106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-88748da2-c7c5-46d9-8d98-803d49432c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:04.614650 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88748da2-c7c5-46d9-8d98-803d49432c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:04.616079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88748da2-c7c5-46d9-8d98-803d49432c4d service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:04.634957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 729/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:06.712916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3cafc-d5fa-4e18-860a-19056e47a929 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:06.713453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3cafc-d5fa-4e18-860a-19056e47a929 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:06.713453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3cafc-d5fa-4e18-860a-19056e47a929 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:06.714806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:06.720450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105418f7-d1c6-4c22-8efb-143b9b63c3da None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:06.720989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105418f7-d1c6-4c22-8efb-143b9b63c3da None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:06.721096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105418f7-d1c6-4c22-8efb-143b9b63c3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:06.788067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-105418f7-d1c6-4c22-8efb-143b9b63c3da None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:06.789389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-105418f7-d1c6-4c22-8efb-143b9b63c3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:06.823352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:06.895718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:07.185389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3cafc-d5fa-4e18-860a-19056e47a929 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:07.187473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ffd3cafc-d5fa-4e18-860a-19056e47a929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:07.298841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3cafc-d5fa-4e18-860a-19056e47a929 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:07.328888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:07.376961 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5884b2f-20a8-48ea-818b-b896e8e9b391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:07.377573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5884b2f-20a8-48ea-818b-b896e8e9b391 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:07.377869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5884b2f-20a8-48ea-818b-b896e8e9b391 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:07.378152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5884b2f-20a8-48ea-818b-b896e8e9b391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:07.379789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b5884b2f-20a8-48ea-818b-b896e8e9b391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:07.491507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5884b2f-20a8-48ea-818b-b896e8e9b391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:07.493001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5884b2f-20a8-48ea-818b-b896e8e9b391 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:07.511001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 728/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:51:09.495041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0cc02-2c54-46f3-818c-40a64eba80ae None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:09.495628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0cc02-2c54-46f3-818c-40a64eba80ae None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:09.495628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0cc02-2c54-46f3-818c-40a64eba80ae None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:09.496948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:09.502901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146d15-fd8e-4c9c-9a28-44712964deb4 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:09.503385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146d15-fd8e-4c9c-9a28-44712964deb4 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:09.503501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146d15-fd8e-4c9c-9a28-44712964deb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:09.569638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-56146d15-fd8e-4c9c-9a28-44712964deb4 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:09.570857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-56146d15-fd8e-4c9c-9a28-44712964deb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:09.580237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:09.669850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:09.957568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0cc02-2c54-46f3-818c-40a64eba80ae None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:09.959090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-94a0cc02-2c54-46f3-818c-40a64eba80ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:10.064401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0cc02-2c54-46f3-818c-40a64eba80ae None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:10.131654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:10.150134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f7ab2-1e5b-49da-900a-bf991cb38a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:10.150738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f7ab2-1e5b-49da-900a-bf991cb38a81 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:10.151015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f7ab2-1e5b-49da-900a-bf991cb38a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:10.151280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f7ab2-1e5b-49da-900a-bf991cb38a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:10.152909 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-772f7ab2-1e5b-49da-900a-bf991cb38a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:10.263785 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f7ab2-1e5b-49da-900a-bf991cb38a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:10.265272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f7ab2-1e5b-49da-900a-bf991cb38a81 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:10.284699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 732/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:12.262790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458051-4ce7-460a-a949-d5a0572135d3 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:12.263363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458051-4ce7-460a-a949-d5a0572135d3 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:12.263363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19458051-4ce7-460a-a949-d5a0572135d3 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:12.265286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:12.271894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59caa16-3f8d-4576-8934-c24df76d3f4f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:12.272547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59caa16-3f8d-4576-8934-c24df76d3f4f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:12.272844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59caa16-3f8d-4576-8934-c24df76d3f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:12.342963 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e59caa16-3f8d-4576-8934-c24df76d3f4f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:12.344184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e59caa16-3f8d-4576-8934-c24df76d3f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:12.384238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:12.442558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:12.729126 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19458051-4ce7-460a-a949-d5a0572135d3 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:12.730655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-19458051-4ce7-460a-a949-d5a0572135d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:12.844430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19458051-4ce7-460a-a949-d5a0572135d3 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:12.884796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:12.922514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296729f-5ef1-4ec6-99ac-0ecd86c6addf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:12.923381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296729f-5ef1-4ec6-99ac-0ecd86c6addf service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:12.923654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296729f-5ef1-4ec6-99ac-0ecd86c6addf service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:12.923919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296729f-5ef1-4ec6-99ac-0ecd86c6addf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:12.925729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d296729f-5ef1-4ec6-99ac-0ecd86c6addf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:13.043050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296729f-5ef1-4ec6-99ac-0ecd86c6addf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:13.044553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296729f-5ef1-4ec6-99ac-0ecd86c6addf service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:13.064713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 731/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:15.045809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997ec7-d075-4f3a-bd75-1598f1925ef6 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:15.046438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997ec7-d075-4f3a-bd75-1598f1925ef6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:15.046438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997ec7-d075-4f3a-bd75-1598f1925ef6 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:15.047630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:15.053437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675a122-3ac0-4c4b-b6c5-2ae51f55cd35 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:15.058084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675a122-3ac0-4c4b-b6c5-2ae51f55cd35 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:15.058084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675a122-3ac0-4c4b-b6c5-2ae51f55cd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:15.124976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4675a122-3ac0-4c4b-b6c5-2ae51f55cd35 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:15.126203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4675a122-3ac0-4c4b-b6c5-2ae51f55cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:15.144718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:15.227002 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:15.520337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71997ec7-d075-4f3a-bd75-1598f1925ef6 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:15.521907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-71997ec7-d075-4f3a-bd75-1598f1925ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:15.631644 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71997ec7-d075-4f3a-bd75-1598f1925ef6 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:15.706033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:15.712744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6931e-8cce-4eb9-b029-6634217a7681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:15.713362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6931e-8cce-4eb9-b029-6634217a7681 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:15.713642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6931e-8cce-4eb9-b029-6634217a7681 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:15.713916 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6931e-8cce-4eb9-b029-6634217a7681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:15.715540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ead6931e-8cce-4eb9-b029-6634217a7681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:15.830242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6931e-8cce-4eb9-b029-6634217a7681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:15.831595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6931e-8cce-4eb9-b029-6634217a7681 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:15.849862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 735/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:17.782994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d0d0c-26c6-4d05-a969-41b020a511c5 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:17.783564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d0d0c-26c6-4d05-a969-41b020a511c5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:17.783564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d0d0c-26c6-4d05-a969-41b020a511c5 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:17.784893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:17.790307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ed0a-bf0b-4d54-ad82-8d87ee92f366 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:17.790728 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ed0a-bf0b-4d54-ad82-8d87ee92f366 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:17.790836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493ed0a-bf0b-4d54-ad82-8d87ee92f366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:17.856324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-6493ed0a-bf0b-4d54-ad82-8d87ee92f366 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:17.858275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6493ed0a-bf0b-4d54-ad82-8d87ee92f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:17.906615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:17.962152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:51:18.247948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d0d0c-26c6-4d05-a969-41b020a511c5 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:18.249555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-024d0d0c-26c6-4d05-a969-41b020a511c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:18.361750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d0d0c-26c6-4d05-a969-41b020a511c5 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:18.410462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:18.442203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd4ec9-e85d-471b-a06e-0b1781a1bb17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:18.444209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd4ec9-e85d-471b-a06e-0b1781a1bb17 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:18.444209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd4ec9-e85d-471b-a06e-0b1781a1bb17 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:18.444209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd4ec9-e85d-471b-a06e-0b1781a1bb17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:18.445122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1fdd4ec9-e85d-471b-a06e-0b1781a1bb17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:18.559282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd4ec9-e85d-471b-a06e-0b1781a1bb17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:18.561172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd4ec9-e85d-471b-a06e-0b1781a1bb17 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:18.580298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 734/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:27.960004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=22 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:28.578000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=66 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:38.584391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe8e2f-1158-4dab-bc2b-325c1280c9cd None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:38.585066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe8e2f-1158-4dab-bc2b-325c1280c9cd None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:38.585066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe8e2f-1158-4dab-bc2b-325c1280c9cd None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:38.586370 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 737/1471] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:38.592817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fcf4e-ca32-41ae-8bbd-9f1ba5485ae1 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:38.593416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fcf4e-ca32-41ae-8bbd-9f1ba5485ae1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:38.593526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fcf4e-ca32-41ae-8bbd-9f1ba5485ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:38.664683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-2d3fcf4e-ca32-41ae-8bbd-9f1ba5485ae1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:38.665926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2d3fcf4e-ca32-41ae-8bbd-9f1ba5485ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:38.763239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 735/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:39.069816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05eb3-800c-4e4e-9944-f13b6a83733c None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:39.070097 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05eb3-800c-4e4e-9944-f13b6a83733c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:39.070367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe05eb3-800c-4e4e-9944-f13b6a83733c None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:39.071698 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 738/1473] 10.222.0.18 () {54 vars in 967 bytes} [Mon Aug 22 15:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:39.077255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a42b5-d20b-470b-9cd9-e94defb53a4d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:39.077552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a42b5-d20b-470b-9cd9-e94defb53a4d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:39.077827 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a42b5-d20b-470b-9cd9-e94defb53a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:39.156761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b33a42b5-d20b-470b-9cd9-e94defb53a4d None None] MFA Rules not processed for user `c2de83ba29194578a9a229d5bab6612e`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:39.157976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b33a42b5-d20b-470b-9cd9-e94defb53a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:39.179581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:39.236482 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 736/1474] 10.222.0.18 () {58 vars in 1064 bytes} [Mon Aug 22 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:39.244284 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05eb3-800c-4e4e-9944-f13b6a83733c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:39.245838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-afe05eb3-800c-4e4e-9944-f13b6a83733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:39.352485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe05eb3-800c-4e4e-9944-f13b6a83733c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:39.428777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca215e61-c6cb-4847-a532-f517c6717fd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2de83ba29194578a9a229d5bab6612e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:39.429383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca215e61-c6cb-4847-a532-f517c6717fd1 service glance] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:39.429661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca215e61-c6cb-4847-a532-f517c6717fd1 service glance] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:39.430179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca215e61-c6cb-4847-a532-f517c6717fd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:39.431842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ca215e61-c6cb-4847-a532-f517c6717fd1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:39.493399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:39.553783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca215e61-c6cb-4847-a532-f517c6717fd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:39.555658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca215e61-c6cb-4847-a532-f517c6717fd1 service glance] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:39.576863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 739/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:41.630342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ab596-d60c-4c43-9713-e5389e8a18a7 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:41.630904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ab596-d60c-4c43-9713-e5389e8a18a7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:41.631018 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ab596-d60c-4c43-9713-e5389e8a18a7 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:41.632433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 737/1476] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:41.638488 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27d1d-6ab6-47a2-9029-a008c1d0299b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:41.639009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27d1d-6ab6-47a2-9029-a008c1d0299b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:41.639123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27d1d-6ab6-47a2-9029-a008c1d0299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:41.706989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-fee27d1d-6ab6-47a2-9029-a008c1d0299b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:41.708210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fee27d1d-6ab6-47a2-9029-a008c1d0299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:41.804176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 740/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:42.075868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ab596-d60c-4c43-9713-e5389e8a18a7 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:42.077566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-748ab596-d60c-4c43-9713-e5389e8a18a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:42.208654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ab596-d60c-4c43-9713-e5389e8a18a7 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:42.258271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:42.303261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54affd-c834-4514-904c-2a721d1b8563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:42.303868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54affd-c834-4514-904c-2a721d1b8563 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:42.304141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54affd-c834-4514-904c-2a721d1b8563 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:42.304405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54affd-c834-4514-904c-2a721d1b8563 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:42.305341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54affd-c834-4514-904c-2a721d1b8563 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:42.307123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: WARNING py.warnings [None req-9a54affd-c834-4514-904c-2a721d1b8563 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:51:42.307123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: warnings.warn(msg) Aug 22 15:51:42.307123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: Aug 22 15:51:42.308248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54affd-c834-4514-904c-2a721d1b8563 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:42.327551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 738/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 15:51:42 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:51:44.281829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60e58f-59d6-436d-af88-dda958e7a043 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:44.282445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60e58f-59d6-436d-af88-dda958e7a043 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:44.282445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60e58f-59d6-436d-af88-dda958e7a043 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:44.283719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 741/1479] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:44.289051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd35943-b5fc-48e2-ac31-0fe1e8618c66 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:44.289512 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd35943-b5fc-48e2-ac31-0fe1e8618c66 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:44.289618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd35943-b5fc-48e2-ac31-0fe1e8618c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:44.357844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4dd35943-b5fc-48e2-ac31-0fe1e8618c66 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:44.359069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4dd35943-b5fc-48e2-ac31-0fe1e8618c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:44.460577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 739/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:44.758155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60e58f-59d6-436d-af88-dda958e7a043 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:44.759669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6e60e58f-59d6-436d-af88-dda958e7a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:44.769274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:44.909636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60e58f-59d6-436d-af88-dda958e7a043 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:44.991194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:45.023702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebe560-3507-46da-b3c3-ebb3c1b864f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:45.024270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe560-3507-46da-b3c3-ebb3c1b864f3 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:45.024573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe560-3507-46da-b3c3-ebb3c1b864f3 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:45.024842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebe560-3507-46da-b3c3-ebb3c1b864f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:45.026426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-51ebe560-3507-46da-b3c3-ebb3c1b864f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:45.118373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebe560-3507-46da-b3c3-ebb3c1b864f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:45.120037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebe560-3507-46da-b3c3-ebb3c1b864f3 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:45.140040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 742/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:51:47.247079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8fafb-acbd-444d-9da6-5fc52e4c72d8 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:47.247664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8fafb-acbd-444d-9da6-5fc52e4c72d8 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:47.247664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8fafb-acbd-444d-9da6-5fc52e4c72d8 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:47.249109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 740/1482] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:47.255072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf57c1-0550-4bd5-a76e-2026cfbe5143 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:47.255550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf57c1-0550-4bd5-a76e-2026cfbe5143 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:47.255658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf57c1-0550-4bd5-a76e-2026cfbe5143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:47.323958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-bccf57c1-0550-4bd5-a76e-2026cfbe5143 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:47.325280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-bccf57c1-0550-4bd5-a76e-2026cfbe5143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:47.373506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:47.423516 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 743/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:47.706141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8fafb-acbd-444d-9da6-5fc52e4c72d8 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:47.707688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-eab8fafb-acbd-444d-9da6-5fc52e4c72d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:47.731668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:47.813589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8fafb-acbd-444d-9da6-5fc52e4c72d8 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:47.886322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e75d-1a4d-40c4-a7fb-cbaf84f0a229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:47.887723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e75d-1a4d-40c4-a7fb-cbaf84f0a229 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:47.887868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e75d-1a4d-40c4-a7fb-cbaf84f0a229 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:47.888119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e75d-1a4d-40c4-a7fb-cbaf84f0a229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:47.889888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-af96e75d-1a4d-40c4-a7fb-cbaf84f0a229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:47.966297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:48.000530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96e75d-1a4d-40c4-a7fb-cbaf84f0a229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:48.002011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96e75d-1a4d-40c4-a7fb-cbaf84f0a229 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:48.020104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 741/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:49.984835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2027bc-3172-4ffb-95a2-f8e6b25a11f3 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:49.985352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2027bc-3172-4ffb-95a2-f8e6b25a11f3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:49.985352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2027bc-3172-4ffb-95a2-f8e6b25a11f3 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:49.986716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 744/1485] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:49.992093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174acbdd-84a9-45a0-8089-090a1fcb8491 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:49.992497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174acbdd-84a9-45a0-8089-090a1fcb8491 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:49.992671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174acbdd-84a9-45a0-8089-090a1fcb8491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:50.061490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-174acbdd-84a9-45a0-8089-090a1fcb8491 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:50.062697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-174acbdd-84a9-45a0-8089-090a1fcb8491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:50.159982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 742/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:50.448790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2027bc-3172-4ffb-95a2-f8e6b25a11f3 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:50.450362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6d2027bc-3172-4ffb-95a2-f8e6b25a11f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:50.554121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2027bc-3172-4ffb-95a2-f8e6b25a11f3 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:50.625996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:50.627732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c230-3ea1-48d9-a47e-55a1f63cf0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:50.628336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c230-3ea1-48d9-a47e-55a1f63cf0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:50.628646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c230-3ea1-48d9-a47e-55a1f63cf0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:50.628926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c230-3ea1-48d9-a47e-55a1f63cf0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:50.630505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-19e5c230-3ea1-48d9-a47e-55a1f63cf0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:50.739656 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c230-3ea1-48d9-a47e-55a1f63cf0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:50.741134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c230-3ea1-48d9-a47e-55a1f63cf0e5 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:50.760988 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 745/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:52.849300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37377e7-fac8-4db6-94bb-7cc42659d753 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:52.849876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37377e7-fac8-4db6-94bb-7cc42659d753 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:52.849876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37377e7-fac8-4db6-94bb-7cc42659d753 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:52.851201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 743/1488] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:52.857403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c1c72-8c9f-46b4-831f-066aa2eba570 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:52.857403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c1c72-8c9f-46b4-831f-066aa2eba570 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:52.857899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c1c72-8c9f-46b4-831f-066aa2eba570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:52.922451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-6c3c1c72-8c9f-46b4-831f-066aa2eba570 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:52.923665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6c3c1c72-8c9f-46b4-831f-066aa2eba570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:52.977511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:53.023164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 746/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:51:53.312792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37377e7-fac8-4db6-94bb-7cc42659d753 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:53.314370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c37377e7-fac8-4db6-94bb-7cc42659d753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:53.353605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:53.424425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37377e7-fac8-4db6-94bb-7cc42659d753 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:53.499061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef6ae-43cf-4c9a-a2f4-289a5cd784be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:53.499668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef6ae-43cf-4c9a-a2f4-289a5cd784be service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:53.499946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef6ae-43cf-4c9a-a2f4-289a5cd784be service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:53.500218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef6ae-43cf-4c9a-a2f4-289a5cd784be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:53.501923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c4cef6ae-43cf-4c9a-a2f4-289a5cd784be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:53.583038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:53.613720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef6ae-43cf-4c9a-a2f4-289a5cd784be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:53.615118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef6ae-43cf-4c9a-a2f4-289a5cd784be service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:53.633966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 744/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:51:56.134721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf220-c51c-4e1b-8462-91b5f441cb39 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:56.135398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf220-c51c-4e1b-8462-91b5f441cb39 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:56.135398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbf220-c51c-4e1b-8462-91b5f441cb39 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:56.136710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 747/1491] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 15:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:56.142059 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ef34-efda-4530-bf9a-eabb65b374cc None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:56.142519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ef34-efda-4530-bf9a-eabb65b374cc None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:56.142626 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ef34-efda-4530-bf9a-eabb65b374cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:56.208681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-fd09ef34-efda-4530-bf9a-eabb65b374cc None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:56.209898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fd09ef34-efda-4530-bf9a-eabb65b374cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:56.307364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 745/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:51:56.604748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbf220-c51c-4e1b-8462-91b5f441cb39 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:56.606372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fdcbf220-c51c-4e1b-8462-91b5f441cb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:56.734859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbf220-c51c-4e1b-8462-91b5f441cb39 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:56.817310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b1c0f-1ff6-400f-aaa1-48ce9fde2875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:56.817916 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1c0f-1ff6-400f-aaa1-48ce9fde2875 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:56.818192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1c0f-1ff6-400f-aaa1-48ce9fde2875 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:56.818503 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1c0f-1ff6-400f-aaa1-48ce9fde2875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:56.820165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-423b1c0f-1ff6-400f-aaa1-48ce9fde2875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:56.830182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:56.946731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b1c0f-1ff6-400f-aaa1-48ce9fde2875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:56.948088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b1c0f-1ff6-400f-aaa1-48ce9fde2875 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:56.967880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 748/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:52:06.305561 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=82 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:06.965943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=50 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:29.526514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b03c1-206a-4226-9920-d9f5b3791026 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:29.527081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b03c1-206a-4226-9920-d9f5b3791026 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:29.527081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b03c1-206a-4226-9920-d9f5b3791026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:29.601347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a65b03c1-206a-4226-9920-d9f5b3791026 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:53:29.602549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a65b03c1-206a-4226-9920-d9f5b3791026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:29.699827 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 746/1494] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:53:29.707981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bc0c9-a7c5-4114-98cd-e3a88fa76ac7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:29.708506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bc0c9-a7c5-4114-98cd-e3a88fa76ac7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:29.708640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bc0c9-a7c5-4114-98cd-e3a88fa76ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:29.786617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-de2bc0c9-a7c5-4114-98cd-e3a88fa76ac7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:53:29.787743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-de2bc0c9-a7c5-4114-98cd-e3a88fa76ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:29.891783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 749/1495] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:53:29.896537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b03c1-206a-4226-9920-d9f5b3791026 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:29.897770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a65b03c1-206a-4226-9920-d9f5b3791026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:29.909885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b03c1-206a-4226-9920-d9f5b3791026 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:29.973871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:30.006464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:30.007177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:30.007453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:30.007714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:30.008346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:30.008674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:30.009674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: WARNING py.warnings [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:53:30.009674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: warnings.warn(msg) Aug 22 15:53:30.009674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: Aug 22 15:53:30.011065 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:30.022114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 747/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:30.031210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bc0c9-a7c5-4114-98cd-e3a88fa76ac7 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:30.040228 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bc0c9-a7c5-4114-98cd-e3a88fa76ac7 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:30.102588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:30.137003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590f52a-26b3-46e3-bef8-25ab88a96d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:30.137608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590f52a-26b3-46e3-bef8-25ab88a96d64 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:30.137885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590f52a-26b3-46e3-bef8-25ab88a96d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:30.138159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590f52a-26b3-46e3-bef8-25ab88a96d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:30.138789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590f52a-26b3-46e3-bef8-25ab88a96d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:30.140574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: WARNING py.warnings [None req-d590f52a-26b3-46e3-bef8-25ab88a96d64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:53:30.140574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: warnings.warn(msg) Aug 22 15:53:30.140574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: Aug 22 15:53:30.141775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590f52a-26b3-46e3-bef8-25ab88a96d64 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:30.314911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 750/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:53:30 2022] POST /identity/v3/projects => generated 377 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:53:30.319076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:30.320687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:30.357302 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cfe2b-d101-4402-bd71-66d6ec05cb70 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:30.453476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ac4e-f9a3-446c-8de5-af697827cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:30.454081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ac4e-f9a3-446c-8de5-af697827cd53 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:30.454356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ac4e-f9a3-446c-8de5-af697827cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:30.454624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ac4e-f9a3-446c-8de5-af697827cd53 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:30.455241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ac4e-f9a3-446c-8de5-af697827cd53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:30.456321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: WARNING py.warnings [None req-8d52ac4e-f9a3-446c-8de5-af697827cd53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:53:30.456321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: warnings.warn(msg) Aug 22 15:53:30.456321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: Aug 22 15:53:30.457627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ac4e-f9a3-446c-8de5-af697827cd53 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:30.607297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 748/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:53:30 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:53:30.611281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590f52a-26b3-46e3-bef8-25ab88a96d64 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:30.612850 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d590f52a-26b3-46e3-bef8-25ab88a96d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:30.676473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590f52a-26b3-46e3-bef8-25ab88a96d64 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:30.764800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:30.774963 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b77d8-2e99-4d21-80ae-7430e78c575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:30.778842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b77d8-2e99-4d21-80ae-7430e78c575c admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:30.778842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b77d8-2e99-4d21-80ae-7430e78c575c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:30.778842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b77d8-2e99-4d21-80ae-7430e78c575c admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:30.778842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b77d8-2e99-4d21-80ae-7430e78c575c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:30.778842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: WARNING py.warnings [None req-719b77d8-2e99-4d21-80ae-7430e78c575c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:53:30.778842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: warnings.warn(msg) Aug 22 15:53:30.778842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: Aug 22 15:53:30.779445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b77d8-2e99-4d21-80ae-7430e78c575c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:30.791515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 751/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:53:30.795644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ac4e-f9a3-446c-8de5-af697827cd53 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:30.797252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8d52ac4e-f9a3-446c-8de5-af697827cd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:30.809389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ac4e-f9a3-446c-8de5-af697827cd53 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:30.834153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:30.904723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749afb5e-9894-4213-9a45-18ed865958fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:30.905291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749afb5e-9894-4213-9a45-18ed865958fe admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:30.905545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749afb5e-9894-4213-9a45-18ed865958fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:30.905812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749afb5e-9894-4213-9a45-18ed865958fe admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:30.906481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749afb5e-9894-4213-9a45-18ed865958fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:30.907486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: WARNING py.warnings [None req-749afb5e-9894-4213-9a45-18ed865958fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:53:30.907486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: warnings.warn(msg) Aug 22 15:53:30.907486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: Aug 22 15:53:30.908377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749afb5e-9894-4213-9a45-18ed865958fe admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:30.923590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 749/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:53:30.927895 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b77d8-2e99-4d21-80ae-7430e78c575c admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:30.929867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-719b77d8-2e99-4d21-80ae-7430e78c575c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:30.964026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b77d8-2e99-4d21-80ae-7430e78c575c admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:31.057373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b93f1-9532-40e4-a61d-998766a2b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:31.058087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b93f1-9532-40e4-a61d-998766a2b819 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:31.058454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b93f1-9532-40e4-a61d-998766a2b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:31.058737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b93f1-9532-40e4-a61d-998766a2b819 admin admin] PATH_INFO: `/v3/projects/863cbd49a2aa48dbb06d88475a682ed0/users/309b7e504f9440b9b0bd41907fcc9190/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:31.081637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b93f1-9532-40e4-a61d-998766a2b819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863cbd49a2aa48dbb06d88475a682ed0, user_id=309b7e504f9440b9b0bd41907fcc9190, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:31.082718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: WARNING py.warnings [None req-c25b93f1-9532-40e4-a61d-998766a2b819 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:53:31.082718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: warnings.warn(msg) Aug 22 15:53:31.082718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: Aug 22 15:53:31.084812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b93f1-9532-40e4-a61d-998766a2b819 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:31.195471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 752/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:53:30 2022] PUT /identity/v3/projects/863cbd49a2aa48dbb06d88475a682ed0/users/309b7e504f9440b9b0bd41907fcc9190/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:53:31.208501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473ea2-0658-4977-aefb-7eb2daf7a951 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:31.208893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473ea2-0658-4977-aefb-7eb2daf7a951 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:31.209263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473ea2-0658-4977-aefb-7eb2daf7a951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:31.277047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-13473ea2-0658-4977-aefb-7eb2daf7a951 None None] MFA Rules not processed for user `309b7e504f9440b9b0bd41907fcc9190`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:53:31.278281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-13473ea2-0658-4977-aefb-7eb2daf7a951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:31.359308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 750/1502] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:53:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:53:31.372943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3cb15-2850-4314-8b0e-b0d2a1e6792a None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:31.373261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3cb15-2850-4314-8b0e-b0d2a1e6792a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:31.373553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3cb15-2850-4314-8b0e-b0d2a1e6792a None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:31.374919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 753/1503] 10.222.0.18 () {54 vars in 964 bytes} [Mon Aug 22 15:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:53:31.379999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481c717-2b21-4f0d-8354-05b9eb9a2747 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:31.380312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481c717-2b21-4f0d-8354-05b9eb9a2747 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:31.380612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481c717-2b21-4f0d-8354-05b9eb9a2747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:31.412365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:31.457303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-2481c717-2b21-4f0d-8354-05b9eb9a2747 None None] MFA Rules not processed for user `d8d073f3152f4825becf78c24539477e`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:53:31.458448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2481c717-2b21-4f0d-8354-05b9eb9a2747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:31.533772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 751/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Aug 22 15:53:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:53:31.542586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3cb15-2850-4314-8b0e-b0d2a1e6792a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:31.544098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-21c3cb15-2850-4314-8b0e-b0d2a1e6792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:31.595833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:31.649001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3cb15-2850-4314-8b0e-b0d2a1e6792a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:31.724977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d41996-8f6a-42b8-8765-4132d31100aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:31.725870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d41996-8f6a-42b8-8765-4132d31100aa service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:31.726312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d41996-8f6a-42b8-8765-4132d31100aa service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:31.726747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d41996-8f6a-42b8-8765-4132d31100aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:31.728812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-39d41996-8f6a-42b8-8765-4132d31100aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:31.828181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d41996-8f6a-42b8-8765-4132d31100aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:31.829645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d41996-8f6a-42b8-8765-4132d31100aa service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:31.833149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:31.847283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 754/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:53:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:53:31.914523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069c5b7-1c80-468e-8600-90442e2e8b37 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:31.915054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069c5b7-1c80-468e-8600-90442e2e8b37 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:31.915054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069c5b7-1c80-468e-8600-90442e2e8b37 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:31.916313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 752/1506] 10.222.0.18 () {52 vars in 830 bytes} [Mon Aug 22 15:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:53:31.920353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d41996-8f6a-42b8-8765-4132d31100aa service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:31.921610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-39d41996-8f6a-42b8-8765-4132d31100aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:32.025545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d41996-8f6a-42b8-8765-4132d31100aa service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:32.118183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:32.118811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:32.119150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:32.119936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] PATH_INFO: `/v3/users/309b7e504f9440b9b0bd41907fcc9190` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:32.132142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=309b7e504f9440b9b0bd41907fcc9190)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:32.133229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: WARNING py.warnings [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:53:32.133229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: warnings.warn(msg) Aug 22 15:53:32.133229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: Aug 22 15:53:32.134453 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:32.144172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:32.705313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309b7e504f9440b9b0bd41907fcc9190'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:53:32.722185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309b7e504f9440b9b0bd41907fcc9190'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:53:32.848919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309b7e504f9440b9b0bd41907fcc9190'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:53:32.849604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309b7e504f9440b9b0bd41907fcc9190'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:53:32.849864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309b7e504f9440b9b0bd41907fcc9190'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:53:32.878929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 755/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:53:31 2022] DELETE /identity/v3/users/309b7e504f9440b9b0bd41907fcc9190 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:53:32.883546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996d136-2343-40be-a060-44ff9c57a7e6 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:32.883832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996d136-2343-40be-a060-44ff9c57a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:32.884107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996d136-2343-40be-a060-44ff9c57a7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:32.942551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4996d136-2343-40be-a060-44ff9c57a7e6 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:53:32.943742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4996d136-2343-40be-a060-44ff9c57a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:33.022272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:33.035582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 753/1508] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:53:33.045500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:33.046728 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:33.147776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe9be7-083a-4ee9-976b-b8f0848a6d52 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:33.203957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:33.222935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef69189-f7f9-4a83-a291-717f3893b5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:33.223529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69189-f7f9-4a83-a291-717f3893b5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:33.223809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69189-f7f9-4a83-a291-717f3893b5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:33.224081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69189-f7f9-4a83-a291-717f3893b5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:33.225773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7ef69189-f7f9-4a83-a291-717f3893b5c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:33.336245 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef69189-f7f9-4a83-a291-717f3893b5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:33.337719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef69189-f7f9-4a83-a291-717f3893b5c1 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:33.355474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 756/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:53:33.906989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996d136-2343-40be-a060-44ff9c57a7e6 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:33.906989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4996d136-2343-40be-a060-44ff9c57a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:33.923224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996d136-2343-40be-a060-44ff9c57a7e6 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:34.033317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:34.036142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:34.036142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:34.036142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] PATH_INFO: `/v3/projects/863cbd49a2aa48dbb06d88475a682ed0` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:34.045482 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=863cbd49a2aa48dbb06d88475a682ed0)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:34.046504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: WARNING py.warnings [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:53:34.046504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: warnings.warn(msg) Aug 22 15:53:34.046504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: Aug 22 15:53:34.047702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:34.237460 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863cbd49a2aa48dbb06d88475a682ed0', 'request_id': 'req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:53:34.343294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863cbd49a2aa48dbb06d88475a682ed0', 'request_id': 'req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:53:34.357990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863cbd49a2aa48dbb06d88475a682ed0', 'request_id': 'req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:53:34.383475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] The token cache is being invalidate because project 863cbd49a2aa48dbb06d88475a682ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:53:34.383764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:53:34.384530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-82098fa9-4a16-4fa8-957f-33e8d2bd9b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:53:34.386062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 754/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:53:33 2022] DELETE /identity/v3/projects/863cbd49a2aa48dbb06d88475a682ed0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:53:43.358095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=62 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:44.381161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:15.654356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45d46a-f751-4101-91f1-c1b41b53091c None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:15.654971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45d46a-f751-4101-91f1-c1b41b53091c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:15.654971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45d46a-f751-4101-91f1-c1b41b53091c None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:15.656307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:15.661489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dcaab-710c-43c2-99da-3c4e114d620c None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:15.662461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dcaab-710c-43c2-99da-3c4e114d620c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:15.662789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dcaab-710c-43c2-99da-3c4e114d620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:15.729979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-227dcaab-710c-43c2-99da-3c4e114d620c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:15.731198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-227dcaab-710c-43c2-99da-3c4e114d620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:15.791935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:15.947444 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45d46a-f751-4101-91f1-c1b41b53091c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:15.949807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-dd45d46a-f751-4101-91f1-c1b41b53091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:16.071272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45d46a-f751-4101-91f1-c1b41b53091c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:16.076772 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1cc69-94eb-4ede-8bf2-749fe533bc0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:16.077378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1cc69-94eb-4ede-8bf2-749fe533bc0c service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:16.077658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1cc69-94eb-4ede-8bf2-749fe533bc0c service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:16.077935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1cc69-94eb-4ede-8bf2-749fe533bc0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:16.086490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1cc69-94eb-4ede-8bf2-749fe533bc0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:16.088077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1cc69-94eb-4ede-8bf2-749fe533bc0c service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:16.097253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 758/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:16.945852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094f43c-92fc-40c0-8166-be5a9986e5f7 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:16.946449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094f43c-92fc-40c0-8166-be5a9986e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:16.946449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094f43c-92fc-40c0-8166-be5a9986e5f7 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:16.947873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:16.952903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c6ef6-08ff-4265-959d-a778ab2af5ed None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:16.953363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c6ef6-08ff-4265-959d-a778ab2af5ed None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:16.953469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c6ef6-08ff-4265-959d-a778ab2af5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:16.975581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-289c6ef6-08ff-4265-959d-a778ab2af5ed None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:16.976802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-289c6ef6-08ff-4265-959d-a778ab2af5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:16.984558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:17.152138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094f43c-92fc-40c0-8166-be5a9986e5f7 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:17.163071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a5ebd-e361-416c-8475-4f837c14f91a None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:17.163358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a5ebd-e361-416c-8475-4f837c14f91a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:17.163636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a5ebd-e361-416c-8475-4f837c14f91a None None] PATH_INFO: `/v3` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:17.165315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 760/1516] 10.222.0.26 () {54 vars in 925 bytes} [Mon Aug 22 15:55:17 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:55:17.167624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094f43c-92fc-40c0-8166-be5a9986e5f7 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:17.171059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da18fa-c0b2-4c9d-9914-a1b3092dff29 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:17.171345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da18fa-c0b2-4c9d-9914-a1b3092dff29 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:17.171618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da18fa-c0b2-4c9d-9914-a1b3092dff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:17.173600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bbe02-c9a9-450e-9f26-17bd254ccb3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:17.174298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bbe02-c9a9-450e-9f26-17bd254ccb3c service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:17.174578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bbe02-c9a9-450e-9f26-17bd254ccb3c service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:17.174892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bbe02-c9a9-450e-9f26-17bd254ccb3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:17.184153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bbe02-c9a9-450e-9f26-17bd254ccb3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:17.185894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bbe02-c9a9-450e-9f26-17bd254ccb3c service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:17.199994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 757/1517] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:17.234605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-74da18fa-c0b2-4c9d-9914-a1b3092dff29 None None] MFA Rules not processed for user `9ecb4e7e9e3042adadd93229f8456eca`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:17.235841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-74da18fa-c0b2-4c9d-9914-a1b3092dff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:17.296442 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:17.315586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 761/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Aug 22 15:55:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:55:21.758589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffe5fa-0dff-451a-a064-808dd3978482 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:21.759112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffe5fa-0dff-451a-a064-808dd3978482 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:21.759112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffe5fa-0dff-451a-a064-808dd3978482 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:21.760357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 758/1519] 10.222.0.18 () {54 vars in 961 bytes} [Mon Aug 22 15:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:21.765304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d91a1a-bf26-4088-a259-533f956ffd44 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:21.765758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d91a1a-bf26-4088-a259-533f956ffd44 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:21.765866 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d91a1a-bf26-4088-a259-533f956ffd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:21.785335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-20d91a1a-bf26-4088-a259-533f956ffd44 None None] MFA Rules not processed for user `9ecb4e7e9e3042adadd93229f8456eca`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:21.786544 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-20d91a1a-bf26-4088-a259-533f956ffd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:21.796566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 762/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Aug 22 15:55:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:21.804964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffe5fa-0dff-451a-a064-808dd3978482 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:21.818715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffe5fa-0dff-451a-a064-808dd3978482 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:21.823751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef024b3-1b37-4c08-8cd7-d75e024af08f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecb4e7e9e3042adadd93229f8456eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:21.830310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef024b3-1b37-4c08-8cd7-d75e024af08f service placement] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:21.830310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef024b3-1b37-4c08-8cd7-d75e024af08f service placement] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:21.830310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef024b3-1b37-4c08-8cd7-d75e024af08f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:21.833668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef024b3-1b37-4c08-8cd7-d75e024af08f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:21.835301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef024b3-1b37-4c08-8cd7-d75e024af08f service placement] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:21.845057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 759/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:55:28.438627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8de380-b290-4ab5-9882-bdfd8ae4598b None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:28.439264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8de380-b290-4ab5-9882-bdfd8ae4598b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:28.439264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8de380-b290-4ab5-9882-bdfd8ae4598b None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:28.440613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:28.445656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98eef2-8b0f-4131-8b4a-adf865c864c2 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:28.446120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98eef2-8b0f-4131-8b4a-adf865c864c2 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:28.446225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98eef2-8b0f-4131-8b4a-adf865c864c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:28.466399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-fd98eef2-8b0f-4131-8b4a-adf865c864c2 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:28.467639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fd98eef2-8b0f-4131-8b4a-adf865c864c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:28.475588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:28.634533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8de380-b290-4ab5-9882-bdfd8ae4598b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:28.648741 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8de380-b290-4ab5-9882-bdfd8ae4598b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:28.654070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be707c-dfbb-437c-acec-4439b4c61cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:28.654659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be707c-dfbb-437c-acec-4439b4c61cd1 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:28.655002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be707c-dfbb-437c-acec-4439b4c61cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:28.655252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be707c-dfbb-437c-acec-4439b4c61cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:28.663325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be707c-dfbb-437c-acec-4439b4c61cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:28.665411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be707c-dfbb-437c-acec-4439b4c61cd1 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:28.674629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 764/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:29.496397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d769e92-8314-4187-a9a1-e31b09340805 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:29.496899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d769e92-8314-4187-a9a1-e31b09340805 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:29.497007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d769e92-8314-4187-a9a1-e31b09340805 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:29.498365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:29.503531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf4697-b841-4c1d-8fbc-86b5d4d838d9 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:29.503952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf4697-b841-4c1d-8fbc-86b5d4d838d9 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:29.504106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf4697-b841-4c1d-8fbc-86b5d4d838d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:29.523472 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-56cf4697-b841-4c1d-8fbc-86b5d4d838d9 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:29.524646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-56cf4697-b841-4c1d-8fbc-86b5d4d838d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:29.532904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:29.686362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d769e92-8314-4187-a9a1-e31b09340805 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:29.700720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d769e92-8314-4187-a9a1-e31b09340805 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:29.706142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f510b72-6b62-411e-921d-7b5432c6cbc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:29.706760 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510b72-6b62-411e-921d-7b5432c6cbc5 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:29.707035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510b72-6b62-411e-921d-7b5432c6cbc5 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:29.707302 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f510b72-6b62-411e-921d-7b5432c6cbc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:29.715835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f510b72-6b62-411e-921d-7b5432c6cbc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:29.717442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f510b72-6b62-411e-921d-7b5432c6cbc5 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:29.726749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 762/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:33.628939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec8e78-c518-4b8d-8b34-a80b4f1fb90a None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:33.629535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec8e78-c518-4b8d-8b34-a80b4f1fb90a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:33.629535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec8e78-c518-4b8d-8b34-a80b4f1fb90a None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:33.630897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:33.636073 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab172eb7-01d8-4113-abc1-700188055b95 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:33.636488 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab172eb7-01d8-4113-abc1-700188055b95 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:33.636653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab172eb7-01d8-4113-abc1-700188055b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:33.656203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ab172eb7-01d8-4113-abc1-700188055b95 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:33.657433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ab172eb7-01d8-4113-abc1-700188055b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:33.665894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:33.953253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec8e78-c518-4b8d-8b34-a80b4f1fb90a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:33.954756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-dcec8e78-c518-4b8d-8b34-a80b4f1fb90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:34.033968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec8e78-c518-4b8d-8b34-a80b4f1fb90a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:34.037628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d67b0c-7cd1-4acc-b854-384f671a5feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:34.038292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d67b0c-7cd1-4acc-b854-384f671a5feb service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:34.038617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d67b0c-7cd1-4acc-b854-384f671a5feb service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:34.038888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d67b0c-7cd1-4acc-b854-384f671a5feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:34.048909 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d67b0c-7cd1-4acc-b854-384f671a5feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:34.050436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d67b0c-7cd1-4acc-b854-384f671a5feb service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:34.061021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 767/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:36.036430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727103f-f8bc-4d1c-9bcb-eaffd0768815 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:36.037037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727103f-f8bc-4d1c-9bcb-eaffd0768815 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:36.037037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727103f-f8bc-4d1c-9bcb-eaffd0768815 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:36.038391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:36.044323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042ded-75b9-4900-b377-eedfdd77cc0f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:36.044769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042ded-75b9-4900-b377-eedfdd77cc0f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:36.044876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042ded-75b9-4900-b377-eedfdd77cc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:36.065205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b8042ded-75b9-4900-b377-eedfdd77cc0f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:36.066408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b8042ded-75b9-4900-b377-eedfdd77cc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:36.074669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:36.356796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727103f-f8bc-4d1c-9bcb-eaffd0768815 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:36.367494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727103f-f8bc-4d1c-9bcb-eaffd0768815 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:36.371476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb4aac-96d9-4aac-a4c8-d83b74c13c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:36.372068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb4aac-96d9-4aac-a4c8-d83b74c13c33 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:36.372345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb4aac-96d9-4aac-a4c8-d83b74c13c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:36.372649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb4aac-96d9-4aac-a4c8-d83b74c13c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:36.381521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb4aac-96d9-4aac-a4c8-d83b74c13c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:36.382942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb4aac-96d9-4aac-a4c8-d83b74c13c33 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:36.393164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 765/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:39.841448 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8045c7c-7707-481f-bfe3-134b92b09f59 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:39.841990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8045c7c-7707-481f-bfe3-134b92b09f59 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:39.841990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8045c7c-7707-481f-bfe3-134b92b09f59 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:39.843238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:39.848534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d83f32-311e-44fc-a5fe-f8438ddeb6f5 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:39.848971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d83f32-311e-44fc-a5fe-f8438ddeb6f5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:39.849142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d83f32-311e-44fc-a5fe-f8438ddeb6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:39.869369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a5d83f32-311e-44fc-a5fe-f8438ddeb6f5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:39.870559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a5d83f32-311e-44fc-a5fe-f8438ddeb6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:39.878700 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:40.434241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8045c7c-7707-481f-bfe3-134b92b09f59 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:40.436054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e8045c7c-7707-481f-bfe3-134b92b09f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:40.519465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8045c7c-7707-481f-bfe3-134b92b09f59 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:40.523087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386931d-2a28-4e45-998b-beeddd6791c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:40.523688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386931d-2a28-4e45-998b-beeddd6791c5 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:40.523967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386931d-2a28-4e45-998b-beeddd6791c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:40.524241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386931d-2a28-4e45-998b-beeddd6791c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:40.534135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386931d-2a28-4e45-998b-beeddd6791c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:40.535683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386931d-2a28-4e45-998b-beeddd6791c5 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:40.547463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 770/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:42.507767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042e17-0327-48b2-bb21-c327b935c238 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:42.508953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042e17-0327-48b2-bb21-c327b935c238 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:42.508953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042e17-0327-48b2-bb21-c327b935c238 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:42.510258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:42.515601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f6e1-073a-453d-a070-0d4e763d515c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:42.515992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f6e1-073a-453d-a070-0d4e763d515c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:42.516161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f6e1-073a-453d-a070-0d4e763d515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:42.535597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-f497f6e1-073a-453d-a070-0d4e763d515c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:42.536830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f497f6e1-073a-453d-a070-0d4e763d515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:42.544729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:55:43.102276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2042e17-0327-48b2-bb21-c327b935c238 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:43.103954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f2042e17-0327-48b2-bb21-c327b935c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:43.116935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2042e17-0327-48b2-bb21-c327b935c238 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:43.120465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635b805-9de3-4d0a-ae05-552444d7eb14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:43.121072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b805-9de3-4d0a-ae05-552444d7eb14 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:43.121343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b805-9de3-4d0a-ae05-552444d7eb14 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:43.121608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b805-9de3-4d0a-ae05-552444d7eb14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:43.130369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635b805-9de3-4d0a-ae05-552444d7eb14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:43.131772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635b805-9de3-4d0a-ae05-552444d7eb14 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:43.141046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 768/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:52.530764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:53.136957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=84 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:11.933969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55052340-cf67-4631-a008-87d1539db7d5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:11.934617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55052340-cf67-4631-a008-87d1539db7d5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:11.934617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55052340-cf67-4631-a008-87d1539db7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:11.958839 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-55052340-cf67-4631-a008-87d1539db7d5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:11.960666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-55052340-cf67-4631-a008-87d1539db7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:11.979805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 772/1540] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:11.989091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966532f-2587-4417-a164-029a2e4d388b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:11.999007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966532f-2587-4417-a164-029a2e4d388b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:11.999007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966532f-2587-4417-a164-029a2e4d388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.029546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e966532f-2587-4417-a164-029a2e4d388b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.030767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e966532f-2587-4417-a164-029a2e4d388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.040678 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 769/1541] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.046135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55052340-cf67-4631-a008-87d1539db7d5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:12.058613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55052340-cf67-4631-a008-87d1539db7d5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:12.071949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ac23d-65cd-4a76-b7f1-32281dddb417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:12.072834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ac23d-65cd-4a76-b7f1-32281dddb417 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.073235 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ac23d-65cd-4a76-b7f1-32281dddb417 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.073619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ac23d-65cd-4a76-b7f1-32281dddb417 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.074656 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ac23d-65cd-4a76-b7f1-32281dddb417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:12.075349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ac23d-65cd-4a76-b7f1-32281dddb417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:12.076416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: WARNING py.warnings [None req-bb8ac23d-65cd-4a76-b7f1-32281dddb417 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:57:12.076416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: warnings.warn(msg) Aug 22 15:57:12.076416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: Aug 22 15:57:12.083575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ac23d-65cd-4a76-b7f1-32281dddb417 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:12.112633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 773/1542] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:12.115665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966532f-2587-4417-a164-029a2e4d388b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:12.130687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966532f-2587-4417-a164-029a2e4d388b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:12.146293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabf23e-9cbe-43aa-9ed3-bcc741917aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:12.146938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabf23e-9cbe-43aa-9ed3-bcc741917aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.147212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabf23e-9cbe-43aa-9ed3-bcc741917aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.148016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabf23e-9cbe-43aa-9ed3-bcc741917aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.148679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabf23e-9cbe-43aa-9ed3-bcc741917aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:12.149873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: WARNING py.warnings [None req-2fabf23e-9cbe-43aa-9ed3-bcc741917aa2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:57:12.149873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: warnings.warn(msg) Aug 22 15:57:12.149873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: Aug 22 15:57:12.151079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabf23e-9cbe-43aa-9ed3-bcc741917aa2 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:12.390589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 770/1543] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/projects => generated 377 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:12.395400 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ac23d-65cd-4a76-b7f1-32281dddb417 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:12.405202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a24682-0eb9-44ca-8ae4-a5112901a5eb None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.405531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a24682-0eb9-44ca-8ae4-a5112901a5eb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.405905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a24682-0eb9-44ca-8ae4-a5112901a5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.413261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ac23d-65cd-4a76-b7f1-32281dddb417 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:12.437638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-36a24682-0eb9-44ca-8ae4-a5112901a5eb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.439019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-36a24682-0eb9-44ca-8ae4-a5112901a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.525266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b82802-79c2-41cb-aeea-ff91aeb39ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:12.526479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b82802-79c2-41cb-aeea-ff91aeb39ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.526992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b82802-79c2-41cb-aeea-ff91aeb39ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.527483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b82802-79c2-41cb-aeea-ff91aeb39ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.528357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b82802-79c2-41cb-aeea-ff91aeb39ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:12.529967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: WARNING py.warnings [None req-36b82802-79c2-41cb-aeea-ff91aeb39ab7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:57:12.529967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: warnings.warn(msg) Aug 22 15:57:12.529967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: Aug 22 15:57:12.531675 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b82802-79c2-41cb-aeea-ff91aeb39ab7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:12.574271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 771/1544] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.580635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de811ddd-8259-4d28-b36e-a84d5ef925b7 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.580635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de811ddd-8259-4d28-b36e-a84d5ef925b7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.580635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de811ddd-8259-4d28-b36e-a84d5ef925b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.613806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-de811ddd-8259-4d28-b36e-a84d5ef925b7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.615203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-de811ddd-8259-4d28-b36e-a84d5ef925b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.626070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 772/1545] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.627871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0be14-2cf6-460a-ae3e-e377f5348493 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.628391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0be14-2cf6-460a-ae3e-e377f5348493 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.628938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0be14-2cf6-460a-ae3e-e377f5348493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.655558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-bae0be14-2cf6-460a-ae3e-e377f5348493 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.655558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bae0be14-2cf6-460a-ae3e-e377f5348493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.661682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 773/1546] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.662847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce503649-4a33-47c2-880f-73e904373561 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.663745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce503649-4a33-47c2-880f-73e904373561 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.664032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce503649-4a33-47c2-880f-73e904373561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.688085 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 774/1547] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:12.689563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbf674-6e2e-4fbb-a9ca-79be4a847180 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.689861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbf674-6e2e-4fbb-a9ca-79be4a847180 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.690133 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbf674-6e2e-4fbb-a9ca-79be4a847180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.695328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ce503649-4a33-47c2-880f-73e904373561 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.696566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ce503649-4a33-47c2-880f-73e904373561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.705370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 774/1548] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.706928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7eb18-e623-4108-a9bd-96e44507d8e5 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.707128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7eb18-e623-4108-a9bd-96e44507d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.707390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7eb18-e623-4108-a9bd-96e44507d8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.712702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-64fbf674-6e2e-4fbb-a9ca-79be4a847180 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.713902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-64fbf674-6e2e-4fbb-a9ca-79be4a847180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.722512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 775/1549] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.723688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3673a-d6d5-465c-b192-f20ab32d63f5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.723968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3673a-d6d5-465c-b192-f20ab32d63f5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.724273 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3673a-d6d5-465c-b192-f20ab32d63f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.736841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d1d7eb18-e623-4108-a9bd-96e44507d8e5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.739169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d1d7eb18-e623-4108-a9bd-96e44507d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.745299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d4b3673a-d6d5-465c-b192-f20ab32d63f5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.746502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d4b3673a-d6d5-465c-b192-f20ab32d63f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.752698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 775/1550] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.752698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fbd0-ec9a-4c97-ac1e-52cd6a3a098e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.752698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fbd0-ec9a-4c97-ac1e-52cd6a3a098e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.752698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fbd0-ec9a-4c97-ac1e-52cd6a3a098e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.763387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 776/1551] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.767524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4480d-dd81-4579-b377-4acbca38442f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.767524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4480d-dd81-4579-b377-4acbca38442f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.767524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4480d-dd81-4579-b377-4acbca38442f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.773597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a2c3fbd0-ec9a-4c97-ac1e-52cd6a3a098e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.774801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a2c3fbd0-ec9a-4c97-ac1e-52cd6a3a098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.786543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 776/1552] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.786543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3fbd0-ec9a-4c97-ac1e-52cd6a3a098e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:12.787919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-60d4480d-dd81-4579-b377-4acbca38442f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.792585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-60d4480d-dd81-4579-b377-4acbca38442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.798185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3fbd0-ec9a-4c97-ac1e-52cd6a3a098e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:12.802351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 777/1553] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.802351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4480d-dd81-4579-b377-4acbca38442f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:12.806596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfc0bf-8f5e-4e05-a03d-feb2dc81bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:12.807219 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc0bf-8f5e-4e05-a03d-feb2dc81bc51 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.807503 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc0bf-8f5e-4e05-a03d-feb2dc81bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.807777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc0bf-8f5e-4e05-a03d-feb2dc81bc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.808429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfc0bf-8f5e-4e05-a03d-feb2dc81bc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:12.810246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfc0bf-8f5e-4e05-a03d-feb2dc81bc51 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:12.813434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4480d-dd81-4579-b377-4acbca38442f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:12.818186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c54cc-78d3-4015-b8d8-3c97053e715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:12.818790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c54cc-78d3-4015-b8d8-3c97053e715f admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.819065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c54cc-78d3-4015-b8d8-3c97053e715f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.820022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c54cc-78d3-4015-b8d8-3c97053e715f admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.820657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c54cc-78d3-4015-b8d8-3c97053e715f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:12.820987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c54cc-78d3-4015-b8d8-3c97053e715f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:12.824275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 777/1554] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:12.824414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c54cc-78d3-4015-b8d8-3c97053e715f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:12.824546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ca99-aec0-4601-ae98-4f6e710ecc95 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.824546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ca99-aec0-4601-ae98-4f6e710ecc95 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.824546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ca99-aec0-4601-ae98-4f6e710ecc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.834856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 778/1555] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:12.836404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95cba8-f26b-44a8-82df-afb0fca8a660 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.836728 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95cba8-f26b-44a8-82df-afb0fca8a660 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.837003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95cba8-f26b-44a8-82df-afb0fca8a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.842751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8722ca99-aec0-4601-ae98-4f6e710ecc95 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.843975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8722ca99-aec0-4601-ae98-4f6e710ecc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.852121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 778/1556] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.853053 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722ca99-aec0-4601-ae98-4f6e710ecc95 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:12.858338 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4a95cba8-f26b-44a8-82df-afb0fca8a660 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.859537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4a95cba8-f26b-44a8-82df-afb0fca8a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.862781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722ca99-aec0-4601-ae98-4f6e710ecc95 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:12.868151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b709-5a7e-4ece-b4b6-1d9f4bc67d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:12.868764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 779/1557] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.869186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b709-5a7e-4ece-b4b6-1d9f4bc67d64 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.869391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95cba8-f26b-44a8-82df-afb0fca8a660 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:12.869579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b709-5a7e-4ece-b4b6-1d9f4bc67d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.869810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b709-5a7e-4ece-b4b6-1d9f4bc67d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.870468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b709-5a7e-4ece-b4b6-1d9f4bc67d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:12.870774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b709-5a7e-4ece-b4b6-1d9f4bc67d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:12.872594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b709-5a7e-4ece-b4b6-1d9f4bc67d64 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:12.878810 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95cba8-f26b-44a8-82df-afb0fca8a660 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:12.884182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd99bd5-8c06-40be-ae69-2c9dc4e1ada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:12.884813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99bd5-8c06-40be-ae69-2c9dc4e1ada0 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.885096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99bd5-8c06-40be-ae69-2c9dc4e1ada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.885363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd99bd5-8c06-40be-ae69-2c9dc4e1ada0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.885675 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 779/1558] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:12.886152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd99bd5-8c06-40be-ae69-2c9dc4e1ada0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:12.886300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd99bd5-8c06-40be-ae69-2c9dc4e1ada0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:12.886907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83fb3-7740-47a2-a1f7-0f33b2669687 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.887186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83fb3-7740-47a2-a1f7-0f33b2669687 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.887453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83fb3-7740-47a2-a1f7-0f33b2669687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.887894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd99bd5-8c06-40be-ae69-2c9dc4e1ada0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:12.900546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 780/1559] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:12.901788 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153e23-6f6a-4210-be99-8496519c2270 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.902076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153e23-6f6a-4210-be99-8496519c2270 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.902343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b153e23-6f6a-4210-be99-8496519c2270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.913778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-56d83fb3-7740-47a2-a1f7-0f33b2669687 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.914940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-56d83fb3-7740-47a2-a1f7-0f33b2669687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.921396 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-6b153e23-6f6a-4210-be99-8496519c2270 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:12.922591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6b153e23-6f6a-4210-be99-8496519c2270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:12.924874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 780/1560] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.925717 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83fb3-7740-47a2-a1f7-0f33b2669687 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:12.934676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 781/1561] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:12.935472 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b153e23-6f6a-4210-be99-8496519c2270 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:12.939290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83fb3-7740-47a2-a1f7-0f33b2669687 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:12.943882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e8a2-0d79-48e2-aefb-6597f635ad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:12.945057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e8a2-0d79-48e2-aefb-6597f635ad06 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.945337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e8a2-0d79-48e2-aefb-6597f635ad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.945606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07e8a2-0d79-48e2-aefb-6597f635ad06 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.945856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b153e23-6f6a-4210-be99-8496519c2270 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:12.946406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07e8a2-0d79-48e2-aefb-6597f635ad06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:12.948009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07e8a2-0d79-48e2-aefb-6597f635ad06 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:12.950421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518170f-8c7b-451d-8f81-d508d31e6158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:12.951014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518170f-8c7b-451d-8f81-d508d31e6158 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.951297 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518170f-8c7b-451d-8f81-d508d31e6158 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.951572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518170f-8c7b-451d-8f81-d508d31e6158 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.952313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518170f-8c7b-451d-8f81-d508d31e6158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:12.954249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518170f-8c7b-451d-8f81-d508d31e6158 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:12.958195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 781/1562] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:12.958853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e8a2-0d79-48e2-aefb-6597f635ad06 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:12.968632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07e8a2-0d79-48e2-aefb-6597f635ad06 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:12.973504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c9f1c-9a72-4fcb-807b-f04d3f36caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:12.974166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9f1c-9a72-4fcb-807b-f04d3f36caa6 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:12.974445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9f1c-9a72-4fcb-807b-f04d3f36caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:12.974721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9f1c-9a72-4fcb-807b-f04d3f36caa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:12.975389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c9f1c-9a72-4fcb-807b-f04d3f36caa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:12.975696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c9f1c-9a72-4fcb-807b-f04d3f36caa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:12.977342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c9f1c-9a72-4fcb-807b-f04d3f36caa6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:12.989567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 782/1563] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:12.990499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c9f1c-9a72-4fcb-807b-f04d3f36caa6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:13.000640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c9f1c-9a72-4fcb-807b-f04d3f36caa6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:13.005217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59db86-a127-4f6e-b66f-eb1a401681a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:13.005789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59db86-a127-4f6e-b66f-eb1a401681a3 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:13.006069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59db86-a127-4f6e-b66f-eb1a401681a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:13.006343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59db86-a127-4f6e-b66f-eb1a401681a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:13.007666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59db86-a127-4f6e-b66f-eb1a401681a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:13.007972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59db86-a127-4f6e-b66f-eb1a401681a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:13.009572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59db86-a127-4f6e-b66f-eb1a401681a3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:13.020960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 783/1564] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:13.021848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59db86-a127-4f6e-b66f-eb1a401681a3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:13.031138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59db86-a127-4f6e-b66f-eb1a401681a3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:13.035659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27312e5e-e682-44c7-8059-d216adba34e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:13.036222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27312e5e-e682-44c7-8059-d216adba34e5 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:13.036502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27312e5e-e682-44c7-8059-d216adba34e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:13.036804 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27312e5e-e682-44c7-8059-d216adba34e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:13.037411 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27312e5e-e682-44c7-8059-d216adba34e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:13.039804 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27312e5e-e682-44c7-8059-d216adba34e5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:13.055986 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:13.134744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 782/1565] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:12 2022] POST /identity/v3/projects => generated 389 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:13.135563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518170f-8c7b-451d-8f81-d508d31e6158 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:13.181783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 784/1566] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:13 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:13.183081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecc125-e13e-413e-b288-08485f23a837 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:13.183379 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecc125-e13e-413e-b288-08485f23a837 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:13.183642 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecc125-e13e-413e-b288-08485f23a837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:13.185776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:13.198175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518170f-8c7b-451d-8f81-d508d31e6158 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:13.202753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3eecc125-e13e-413e-b288-08485f23a837 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:13.204007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3eecc125-e13e-413e-b288-08485f23a837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:13.252490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cf6a1-b5d8-446f-bb0d-0e1f73919a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:13.253139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cf6a1-b5d8-446f-bb0d-0e1f73919a4d admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:13.253450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cf6a1-b5d8-446f-bb0d-0e1f73919a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:13.253725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cf6a1-b5d8-446f-bb0d-0e1f73919a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:13.254352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cf6a1-b5d8-446f-bb0d-0e1f73919a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:13.256263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cf6a1-b5d8-446f-bb0d-0e1f73919a4d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:13.261431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 785/1567] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:13.262082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecc125-e13e-413e-b288-08485f23a837 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:13.271451 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecc125-e13e-413e-b288-08485f23a837 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:13.276169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d28613-aeb6-4512-b4ee-1a21b69264db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:13.282876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d28613-aeb6-4512-b4ee-1a21b69264db admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:13.282876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d28613-aeb6-4512-b4ee-1a21b69264db admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:13.282876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d28613-aeb6-4512-b4ee-1a21b69264db admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:13.282876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d28613-aeb6-4512-b4ee-1a21b69264db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:13.282876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d28613-aeb6-4512-b4ee-1a21b69264db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:13.282876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d28613-aeb6-4512-b4ee-1a21b69264db admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:13.291729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 786/1568] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:13.292485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d28613-aeb6-4512-b4ee-1a21b69264db admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:13.301629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d28613-aeb6-4512-b4ee-1a21b69264db admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:13.307726 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47376c89-206c-4ee3-a208-1d6729ea310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:13.308410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47376c89-206c-4ee3-a208-1d6729ea310a admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:13.308730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47376c89-206c-4ee3-a208-1d6729ea310a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:13.309013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47376c89-206c-4ee3-a208-1d6729ea310a admin admin] PATH_INFO: `/v3/projects/77e721475b1045d1a1602dc697362f2f/users/c4415fe3e3704fde82f2dea0622d725f/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:13.324539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47376c89-206c-4ee3-a208-1d6729ea310a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e721475b1045d1a1602dc697362f2f, user_id=c4415fe3e3704fde82f2dea0622d725f, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:13.325593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: WARNING py.warnings [None req-47376c89-206c-4ee3-a208-1d6729ea310a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:57:13.325593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: warnings.warn(msg) Aug 22 15:57:13.325593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: Aug 22 15:57:13.327552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47376c89-206c-4ee3-a208-1d6729ea310a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:13.452266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 783/1569] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:13 2022] POST /identity/v3/projects => generated 365 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:13.452266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cf6a1-b5d8-446f-bb0d-0e1f73919a4d admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:13.487382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 787/1570] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:13 2022] PUT /identity/v3/projects/77e721475b1045d1a1602dc697362f2f/users/c4415fe3e3704fde82f2dea0622d725f/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:13.488202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47376c89-206c-4ee3-a208-1d6729ea310a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:13.513956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cf6a1-b5d8-446f-bb0d-0e1f73919a4d admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:13.551432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47376c89-206c-4ee3-a208-1d6729ea310a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:13.558178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed6a50-4444-4f5f-a3e5-c223671569f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:13.558178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed6a50-4444-4f5f-a3e5-c223671569f6 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:13.558178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed6a50-4444-4f5f-a3e5-c223671569f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:13.558178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed6a50-4444-4f5f-a3e5-c223671569f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:13.558667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed6a50-4444-4f5f-a3e5-c223671569f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:13.560480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed6a50-4444-4f5f-a3e5-c223671569f6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:13.573109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db92697-cc09-4045-85a2-e7db34cdf4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:13.573760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92697-cc09-4045-85a2-e7db34cdf4cd admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:13.574135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92697-cc09-4045-85a2-e7db34cdf4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:13.574435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92697-cc09-4045-85a2-e7db34cdf4cd admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:13.575056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db92697-cc09-4045-85a2-e7db34cdf4cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:13.577026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db92697-cc09-4045-85a2-e7db34cdf4cd admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:13.848421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 784/1571] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:13 2022] POST /identity/v3/projects => generated 373 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:13.849290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db92697-cc09-4045-85a2-e7db34cdf4cd admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:13.862277 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:13.872428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 788/1572] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:13 2022] POST /identity/v3/projects => generated 367 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:13.873321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed6a50-4444-4f5f-a3e5-c223671569f6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:13.912688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db92697-cc09-4045-85a2-e7db34cdf4cd admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:13.922200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:13.939873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed6a50-4444-4f5f-a3e5-c223671569f6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:13.944422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561864b4-9914-4afb-8731-db15982bbdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:13.945051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561864b4-9914-4afb-8731-db15982bbdbb admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:13.945323 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561864b4-9914-4afb-8731-db15982bbdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:13.945588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561864b4-9914-4afb-8731-db15982bbdbb admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:13.946207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561864b4-9914-4afb-8731-db15982bbdbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:13.948134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561864b4-9914-4afb-8731-db15982bbdbb admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:13.969629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895289a-160a-42a2-98a9-ecf6364541ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:13.970370 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895289a-160a-42a2-98a9-ecf6364541ef admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:13.970650 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895289a-160a-42a2-98a9-ecf6364541ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:13.970920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895289a-160a-42a2-98a9-ecf6364541ef admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:13.971540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895289a-160a-42a2-98a9-ecf6364541ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:13.973536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895289a-160a-42a2-98a9-ecf6364541ef admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.207796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 789/1573] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:13 2022] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:14.208565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561864b4-9914-4afb-8731-db15982bbdbb admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:14.218801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561864b4-9914-4afb-8731-db15982bbdbb admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:14.223409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede3f1a-c7dc-4d28-80cc-599f20678fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:14.223992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede3f1a-c7dc-4d28-80cc-599f20678fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.224269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede3f1a-c7dc-4d28-80cc-599f20678fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.224557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede3f1a-c7dc-4d28-80cc-599f20678fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.225248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede3f1a-c7dc-4d28-80cc-599f20678fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:14.226208 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede3f1a-c7dc-4d28-80cc-599f20678fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:14.227792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede3f1a-c7dc-4d28-80cc-599f20678fe3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.239581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 790/1574] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:14.240336 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede3f1a-c7dc-4d28-80cc-599f20678fe3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:14.249538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede3f1a-c7dc-4d28-80cc-599f20678fe3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:14.254040 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4263f10-e746-4df3-ac06-e7f0aec55da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:14.254671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4263f10-e746-4df3-ac06-e7f0aec55da6 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.254984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4263f10-e746-4df3-ac06-e7f0aec55da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.255249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4263f10-e746-4df3-ac06-e7f0aec55da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.255899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4263f10-e746-4df3-ac06-e7f0aec55da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:14.258208 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4263f10-e746-4df3-ac06-e7f0aec55da6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.262888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 785/1575] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:13 2022] POST /identity/v3/users => generated 295 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:14.263582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895289a-160a-42a2-98a9-ecf6364541ef admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:14.274425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895289a-160a-42a2-98a9-ecf6364541ef admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:14.279881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f3e2f-bd0f-4256-8105-f394e744b588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:14.280617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f3e2f-bd0f-4256-8105-f394e744b588 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.280940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f3e2f-bd0f-4256-8105-f394e744b588 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.281251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f3e2f-bd0f-4256-8105-f394e744b588 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.281930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f3e2f-bd0f-4256-8105-f394e744b588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:14.283960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f3e2f-bd0f-4256-8105-f394e744b588 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.447473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 786/1576] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:14 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:14.448941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 791/1577] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:14 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:14.449065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7d17-be99-4b40-90d3-4ccc547b7b29 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.449267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7d17-be99-4b40-90d3-4ccc547b7b29 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.449781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4263f10-e746-4df3-ac06-e7f0aec55da6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:14.449904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7d17-be99-4b40-90d3-4ccc547b7b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.476007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b17f7d17-be99-4b40-90d3-4ccc547b7b29 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:14.476007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b17f7d17-be99-4b40-90d3-4ccc547b7b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:14.514870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4263f10-e746-4df3-ac06-e7f0aec55da6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:14.519586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf579ae-469c-4219-82e9-3bd40f762c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:14.520239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf579ae-469c-4219-82e9-3bd40f762c6c admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.520524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf579ae-469c-4219-82e9-3bd40f762c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.521335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf579ae-469c-4219-82e9-3bd40f762c6c admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.521592 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf579ae-469c-4219-82e9-3bd40f762c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:14.524138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf579ae-469c-4219-82e9-3bd40f762c6c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.532698 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 787/1578] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:14.537102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f7d17-be99-4b40-90d3-4ccc547b7b29 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:14.547026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f7d17-be99-4b40-90d3-4ccc547b7b29 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:14.551690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb984c-5611-4c66-a7bd-7ca865d2455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:14.552317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb984c-5611-4c66-a7bd-7ca865d2455c admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.552639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb984c-5611-4c66-a7bd-7ca865d2455c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.552914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb984c-5611-4c66-a7bd-7ca865d2455c admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.553823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb984c-5611-4c66-a7bd-7ca865d2455c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:14.555734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb984c-5611-4c66-a7bd-7ca865d2455c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.824958 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 792/1579] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:14 2022] POST /identity/v3/users => generated 287 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:14.825714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf579ae-469c-4219-82e9-3bd40f762c6c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:14.835425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf579ae-469c-4219-82e9-3bd40f762c6c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:14.840149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98130-4f97-429c-b8cd-8691511e2f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:14.840759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98130-4f97-429c-b8cd-8691511e2f14 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.841039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98130-4f97-429c-b8cd-8691511e2f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.841314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98130-4f97-429c-b8cd-8691511e2f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.842026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98130-4f97-429c-b8cd-8691511e2f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:14.843611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98130-4f97-429c-b8cd-8691511e2f14 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.853908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 793/1580] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:14.854671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98130-4f97-429c-b8cd-8691511e2f14 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:14.864104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98130-4f97-429c-b8cd-8691511e2f14 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:14.864922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 788/1581] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:14 2022] POST /identity/v3/users => generated 284 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:14.870469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb984c-5611-4c66-a7bd-7ca865d2455c admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:14.870573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53b12a-99ad-4cf5-8aa1-81cffaa1d6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:14.870573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53b12a-99ad-4cf5-8aa1-81cffaa1d6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.870573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53b12a-99ad-4cf5-8aa1-81cffaa1d6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.870855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53b12a-99ad-4cf5-8aa1-81cffaa1d6c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.871284 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53b12a-99ad-4cf5-8aa1-81cffaa1d6c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:14.873227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53b12a-99ad-4cf5-8aa1-81cffaa1d6c7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.877828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb984c-5611-4c66-a7bd-7ca865d2455c admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:14.882454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9896118-9461-4e9a-b037-cd7177a8b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:14.883053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9896118-9461-4e9a-b037-cd7177a8b790 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.883334 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9896118-9461-4e9a-b037-cd7177a8b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.883608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9896118-9461-4e9a-b037-cd7177a8b790 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.884247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9896118-9461-4e9a-b037-cd7177a8b790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:14.885933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9896118-9461-4e9a-b037-cd7177a8b790 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.897077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 789/1582] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:14.897903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9896118-9461-4e9a-b037-cd7177a8b790 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:14.903876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:14.907716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9896118-9461-4e9a-b037-cd7177a8b790 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:14.912615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb124cf-cce4-4802-9326-b6f04ccc5d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:14.916348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb124cf-cce4-4802-9326-b6f04ccc5d20 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.916348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb124cf-cce4-4802-9326-b6f04ccc5d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.916348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb124cf-cce4-4802-9326-b6f04ccc5d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.916348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb124cf-cce4-4802-9326-b6f04ccc5d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:14.916777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb124cf-cce4-4802-9326-b6f04ccc5d20 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.926481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 790/1583] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:14.927381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb124cf-cce4-4802-9326-b6f04ccc5d20 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:14.937659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb124cf-cce4-4802-9326-b6f04ccc5d20 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:14.942279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325242-6681-4204-a8ad-b1589e31793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:14.942875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325242-6681-4204-a8ad-b1589e31793f admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.943161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325242-6681-4204-a8ad-b1589e31793f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.943430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325242-6681-4204-a8ad-b1589e31793f admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.944031 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57325242-6681-4204-a8ad-b1589e31793f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:14.945951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57325242-6681-4204-a8ad-b1589e31793f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:14.997477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 794/1584] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:14 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:14.998318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53b12a-99ad-4cf5-8aa1-81cffaa1d6c7 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.051906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53b12a-99ad-4cf5-8aa1-81cffaa1d6c7 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.055783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959aa3c-ab26-44e0-b3d1-8e19f4aa780a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.056423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959aa3c-ab26-44e0-b3d1-8e19f4aa780a service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.056734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959aa3c-ab26-44e0-b3d1-8e19f4aa780a service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.057005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959aa3c-ab26-44e0-b3d1-8e19f4aa780a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.062433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:15.116111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959aa3c-ab26-44e0-b3d1-8e19f4aa780a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.117499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959aa3c-ab26-44e0-b3d1-8e19f4aa780a service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.127553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 795/1585] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:15.127706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959aa3c-ab26-44e0-b3d1-8e19f4aa780a service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.136473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959aa3c-ab26-44e0-b3d1-8e19f4aa780a service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.141627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93fa1-e18b-4418-a8e4-724f1ae0e3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.142232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93fa1-e18b-4418-a8e4-724f1ae0e3cf admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.142509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93fa1-e18b-4418-a8e4-724f1ae0e3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.142775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93fa1-e18b-4418-a8e4-724f1ae0e3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.143526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e93fa1-e18b-4418-a8e4-724f1ae0e3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.145176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e93fa1-e18b-4418-a8e4-724f1ae0e3cf admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.149132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 791/1586] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:14 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:15.149132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325242-6681-4204-a8ad-b1589e31793f admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.159149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 796/1587] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:15.159149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93fa1-e18b-4418-a8e4-724f1ae0e3cf admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.161946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325242-6681-4204-a8ad-b1589e31793f admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.167218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93fa1-e18b-4418-a8e4-724f1ae0e3cf admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.167342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dad93e-31e5-4cb2-a0d1-a881ac5a83ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.167792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dad93e-31e5-4cb2-a0d1-a881ac5a83ec admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.168070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dad93e-31e5-4cb2-a0d1-a881ac5a83ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.168336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dad93e-31e5-4cb2-a0d1-a881ac5a83ec admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.169022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dad93e-31e5-4cb2-a0d1-a881ac5a83ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.170597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dad93e-31e5-4cb2-a0d1-a881ac5a83ec admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.171869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b0dd-f00d-4479-98ea-29f25fea1920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.172559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b0dd-f00d-4479-98ea-29f25fea1920 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.172790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b0dd-f00d-4479-98ea-29f25fea1920 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.173061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1b0dd-f00d-4479-98ea-29f25fea1920 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.173750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1b0dd-f00d-4479-98ea-29f25fea1920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.175423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1b0dd-f00d-4479-98ea-29f25fea1920 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.185870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 792/1588] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:15.185870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dad93e-31e5-4cb2-a0d1-a881ac5a83ec admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.186466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 797/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:15.187416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b0dd-f00d-4479-98ea-29f25fea1920 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.196915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dad93e-31e5-4cb2-a0d1-a881ac5a83ec admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.197166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1b0dd-f00d-4479-98ea-29f25fea1920 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.201389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4a3d0-723c-41ab-a66a-8b0e82905ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.201810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a94db4-b9d0-43f3-bdc3-524829243134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.202033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4a3d0-723c-41ab-a66a-8b0e82905ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.202274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4a3d0-723c-41ab-a66a-8b0e82905ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.202390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a94db4-b9d0-43f3-bdc3-524829243134 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.202569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4a3d0-723c-41ab-a66a-8b0e82905ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.202704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a94db4-b9d0-43f3-bdc3-524829243134 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.202976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a94db4-b9d0-43f3-bdc3-524829243134 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.203163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4a3d0-723c-41ab-a66a-8b0e82905ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.203620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a94db4-b9d0-43f3-bdc3-524829243134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.204769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4a3d0-723c-41ab-a66a-8b0e82905ae5 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.205198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a94db4-b9d0-43f3-bdc3-524829243134 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.215142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 793/1590] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:15.215913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4a3d0-723c-41ab-a66a-8b0e82905ae5 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.216935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 798/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:15.218487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a94db4-b9d0-43f3-bdc3-524829243134 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.225458 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4a3d0-723c-41ab-a66a-8b0e82905ae5 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.229394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a94db4-b9d0-43f3-bdc3-524829243134 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.230674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2d5d1-e55f-4d3c-81da-939320556b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.231256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2d5d1-e55f-4d3c-81da-939320556b1a admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.231530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2d5d1-e55f-4d3c-81da-939320556b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.231813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2d5d1-e55f-4d3c-81da-939320556b1a admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.232405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2d5d1-e55f-4d3c-81da-939320556b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.234114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90edca-adc7-4c2a-9c5e-210dc9b6f3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.234342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2d5d1-e55f-4d3c-81da-939320556b1a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.235912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90edca-adc7-4c2a-9c5e-210dc9b6f3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.235912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90edca-adc7-4c2a-9c5e-210dc9b6f3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.235912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90edca-adc7-4c2a-9c5e-210dc9b6f3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.236197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90edca-adc7-4c2a-9c5e-210dc9b6f3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.237581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90edca-adc7-4c2a-9c5e-210dc9b6f3f4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.247479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 799/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:15.248332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90edca-adc7-4c2a-9c5e-210dc9b6f3f4 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.257978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90edca-adc7-4c2a-9c5e-210dc9b6f3f4 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.262570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e79b71-d064-4bd2-b83d-99a088b16dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.263145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e79b71-d064-4bd2-b83d-99a088b16dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.263416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e79b71-d064-4bd2-b83d-99a088b16dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.263682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e79b71-d064-4bd2-b83d-99a088b16dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.264313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e79b71-d064-4bd2-b83d-99a088b16dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.265907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e79b71-d064-4bd2-b83d-99a088b16dd5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.276007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 800/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:15.276790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e79b71-d064-4bd2-b83d-99a088b16dd5 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.286199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e79b71-d064-4bd2-b83d-99a088b16dd5 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.291337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c087a4-da16-4f74-8242-a50560683be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.291948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c087a4-da16-4f74-8242-a50560683be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.292219 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c087a4-da16-4f74-8242-a50560683be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.292490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c087a4-da16-4f74-8242-a50560683be8 admin admin] PATH_INFO: `/v3/projects/cb1f5168df5d4518a8a3815ba04fe2c8/users/b6bc6eecd2af449894f93233b8807544/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.306739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c087a4-da16-4f74-8242-a50560683be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1f5168df5d4518a8a3815ba04fe2c8, user_id=b6bc6eecd2af449894f93233b8807544, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.309462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c087a4-da16-4f74-8242-a50560683be8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.362043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 794/1594] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:15 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:15.363021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2d5d1-e55f-4d3c-81da-939320556b1a admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.373649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2d5d1-e55f-4d3c-81da-939320556b1a admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.378405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7d545-47e3-49ba-b041-65c818b2c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.379067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d545-47e3-49ba-b041-65c818b2c61a admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.379349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d545-47e3-49ba-b041-65c818b2c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.379620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d545-47e3-49ba-b041-65c818b2c61a admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.380257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7d545-47e3-49ba-b041-65c818b2c61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.381886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7d545-47e3-49ba-b041-65c818b2c61a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.393203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 795/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:15.394001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7d545-47e3-49ba-b041-65c818b2c61a admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.404180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7d545-47e3-49ba-b041-65c818b2c61a admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.408809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f9142-79e1-4193-b647-da42377b4445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.409446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f9142-79e1-4193-b647-da42377b4445 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.409800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f9142-79e1-4193-b647-da42377b4445 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.409995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f9142-79e1-4193-b647-da42377b4445 admin admin] PATH_INFO: `/v3/projects/f980c394796743c19e9c36b8c0c0e544/users/511ddb50fc25452fac22ed8396542f96/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.424805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f9142-79e1-4193-b647-da42377b4445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f980c394796743c19e9c36b8c0c0e544, user_id=511ddb50fc25452fac22ed8396542f96, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.427454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f9142-79e1-4193-b647-da42377b4445 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.499456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 801/1596] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:15 2022] PUT /identity/v3/projects/cb1f5168df5d4518a8a3815ba04fe2c8/users/b6bc6eecd2af449894f93233b8807544/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:15.500555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c087a4-da16-4f74-8242-a50560683be8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.540358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 796/1597] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:15 2022] PUT /identity/v3/projects/f980c394796743c19e9c36b8c0c0e544/users/511ddb50fc25452fac22ed8396542f96/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:15.544899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f9142-79e1-4193-b647-da42377b4445 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.567126 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c087a4-da16-4f74-8242-a50560683be8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.608077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:15.621631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f9142-79e1-4193-b647-da42377b4445 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.627648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746edec-1166-4355-ab51-13e6120a7ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.628192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746edec-1166-4355-ab51-13e6120a7ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.628470 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746edec-1166-4355-ab51-13e6120a7ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.628832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746edec-1166-4355-ab51-13e6120a7ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.637424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746edec-1166-4355-ab51-13e6120a7ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.637424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746edec-1166-4355-ab51-13e6120a7ec4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.640879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430eda5-7d40-48a3-b778-b43d147de843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.641561 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430eda5-7d40-48a3-b778-b43d147de843 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.641841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430eda5-7d40-48a3-b778-b43d147de843 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.642115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430eda5-7d40-48a3-b778-b43d147de843 admin admin] PATH_INFO: `/v3/projects/f5b8dc0a6d1d430ba677bf1c7dc37b2d/users/061658e3bb2541bb905b48f071ff5668/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.642719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 797/1598] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:15.643568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746edec-1166-4355-ab51-13e6120a7ec4 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.654334 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746edec-1166-4355-ab51-13e6120a7ec4 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.659783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bc04a-ac9a-4b9e-8c6b-82dd253ced94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.660298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bc04a-ac9a-4b9e-8c6b-82dd253ced94 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.660603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bc04a-ac9a-4b9e-8c6b-82dd253ced94 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.660894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bc04a-ac9a-4b9e-8c6b-82dd253ced94 admin admin] PATH_INFO: `/v3/projects/117071f4b33f4dcdb95d1290f56f067c/users/80ef36598fba48c19bb97678fdf5363f/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.662888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430eda5-7d40-48a3-b778-b43d147de843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b8dc0a6d1d430ba677bf1c7dc37b2d, user_id=061658e3bb2541bb905b48f071ff5668, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.667034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430eda5-7d40-48a3-b778-b43d147de843 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.676258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bc04a-ac9a-4b9e-8c6b-82dd253ced94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=117071f4b33f4dcdb95d1290f56f067c, user_id=80ef36598fba48c19bb97678fdf5363f, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.679711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bc04a-ac9a-4b9e-8c6b-82dd253ced94 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.887508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 798/1599] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:15 2022] PUT /identity/v3/projects/117071f4b33f4dcdb95d1290f56f067c/users/80ef36598fba48c19bb97678fdf5363f/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:15.889243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 802/1600] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:15 2022] PUT /identity/v3/projects/f5b8dc0a6d1d430ba677bf1c7dc37b2d/users/061658e3bb2541bb905b48f071ff5668/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:15.890633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430eda5-7d40-48a3-b778-b43d147de843 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.899506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bc04a-ac9a-4b9e-8c6b-82dd253ced94 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.939457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:15.972946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430eda5-7d40-48a3-b778-b43d147de843 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.975299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bc04a-ac9a-4b9e-8c6b-82dd253ced94 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.977656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c9579-eed5-4953-8c9c-9997964723ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.978321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c9579-eed5-4953-8c9c-9997964723ef admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.985696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c9579-eed5-4953-8c9c-9997964723ef admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.985696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c9579-eed5-4953-8c9c-9997964723ef admin admin] PATH_INFO: `/v3/projects/20c8e459f89d4bea956fc5c3a6bbb84c/users/2beaa81ed0ee47c4a0f50f78792a43a7/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.985918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae07c99-31ae-41ff-a0de-1aa74e613dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.985918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07c99-31ae-41ff-a0de-1aa74e613dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.985918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07c99-31ae-41ff-a0de-1aa74e613dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.985918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae07c99-31ae-41ff-a0de-1aa74e613dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.986231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae07c99-31ae-41ff-a0de-1aa74e613dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.986231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae07c99-31ae-41ff-a0de-1aa74e613dd7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.996987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c9579-eed5-4953-8c9c-9997964723ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c8e459f89d4bea956fc5c3a6bbb84c, user_id=2beaa81ed0ee47c4a0f50f78792a43a7, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.998162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 799/1601] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:15.999536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc972144-0cc4-4ce0-ae51-cafc42921da8 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.999885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc972144-0cc4-4ce0-ae51-cafc42921da8 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.000234 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc972144-0cc4-4ce0-ae51-cafc42921da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.001006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c9579-eed5-4953-8c9c-9997964723ef admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:16.023283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-fc972144-0cc4-4ce0-ae51-cafc42921da8 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:16.024966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fc972144-0cc4-4ce0-ae51-cafc42921da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:16.032016 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 800/1602] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:16.033306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6ca1-27c0-417d-ba99-7eb47eab9af7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.033585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6ca1-27c0-417d-ba99-7eb47eab9af7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.033847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6ca1-27c0-417d-ba99-7eb47eab9af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.053648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-845e6ca1-27c0-417d-ba99-7eb47eab9af7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:16.055482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-845e6ca1-27c0-417d-ba99-7eb47eab9af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:16.063704 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 801/1603] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:16.065055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6ca1-27c0-417d-ba99-7eb47eab9af7 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:16.076387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6ca1-27c0-417d-ba99-7eb47eab9af7 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:16.083145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f287a0-53d5-44b1-aad4-b24d3dd3f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:16.083809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f287a0-53d5-44b1-aad4-b24d3dd3f030 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.084090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f287a0-53d5-44b1-aad4-b24d3dd3f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.084364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f287a0-53d5-44b1-aad4-b24d3dd3f030 admin admin] PATH_INFO: `/v3/projects/94d81929179f482a81f4d8ab175aba9e/users/1e513898018544c7924d592c40f7dd54/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.099373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f287a0-53d5-44b1-aad4-b24d3dd3f030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d81929179f482a81f4d8ab175aba9e, user_id=1e513898018544c7924d592c40f7dd54, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:16.102626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f287a0-53d5-44b1-aad4-b24d3dd3f030 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:16.162432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 803/1604] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:15 2022] PUT /identity/v3/projects/20c8e459f89d4bea956fc5c3a6bbb84c/users/2beaa81ed0ee47c4a0f50f78792a43a7/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:16.173830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b38dc-08ef-4683-a5ad-077cdd59c0b1 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.173830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b38dc-08ef-4683-a5ad-077cdd59c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.173830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b38dc-08ef-4683-a5ad-077cdd59c0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.193509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-eb9b38dc-08ef-4683-a5ad-077cdd59c0b1 None None] MFA Rules not processed for user `80ef36598fba48c19bb97678fdf5363f`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:16.197810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-eb9b38dc-08ef-4683-a5ad-077cdd59c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:16.259710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 804/1605] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:16.272314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b26e-bf61-4723-98d3-c1a811d46236 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.272314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b26e-bf61-4723-98d3-c1a811d46236 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.272314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b26e-bf61-4723-98d3-c1a811d46236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.287571 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-f205b26e-bf61-4723-98d3-c1a811d46236 None None] MFA Rules not processed for user `061658e3bb2541bb905b48f071ff5668`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:16.289356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f205b26e-bf61-4723-98d3-c1a811d46236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:16.301314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:16.352195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 805/1606] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:16.353071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205b26e-bf61-4723-98d3-c1a811d46236 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:16.384420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 802/1607] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:16 2022] PUT /identity/v3/projects/94d81929179f482a81f4d8ab175aba9e/users/1e513898018544c7924d592c40f7dd54/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:16.385309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f287a0-53d5-44b1-aad4-b24d3dd3f030 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:16.387141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-48f287a0-53d5-44b1-aad4-b24d3dd3f030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:16.415210 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205b26e-bf61-4723-98d3-c1a811d46236 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:16.453547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f287a0-53d5-44b1-aad4-b24d3dd3f030 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:16.457154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fce453-d265-448a-aaca-7c3d22b1e230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:16.457763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce453-d265-448a-aaca-7c3d22b1e230 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.458038 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce453-d265-448a-aaca-7c3d22b1e230 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.458309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce453-d265-448a-aaca-7c3d22b1e230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.480338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18231b63-f9ac-44a6-a498-186968aca7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:16.481059 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18231b63-f9ac-44a6-a498-186968aca7fe admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.481337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18231b63-f9ac-44a6-a498-186968aca7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.481610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18231b63-f9ac-44a6-a498-186968aca7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.482315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18231b63-f9ac-44a6-a498-186968aca7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:16.484177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18231b63-f9ac-44a6-a498-186968aca7fe admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:16.498602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 806/1608] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:16.498602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18231b63-f9ac-44a6-a498-186968aca7fe admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:16.506438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18231b63-f9ac-44a6-a498-186968aca7fe admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:16.511448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfd47c-a145-4e93-aa46-f7a15d6a1387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:16.511607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd47c-a145-4e93-aa46-f7a15d6a1387 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.511839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd47c-a145-4e93-aa46-f7a15d6a1387 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.512135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd47c-a145-4e93-aa46-f7a15d6a1387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.522168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfd47c-a145-4e93-aa46-f7a15d6a1387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:16.524112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfd47c-a145-4e93-aa46-f7a15d6a1387 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:16.527207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fce453-d265-448a-aaca-7c3d22b1e230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:16.528760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fce453-d265-448a-aaca-7c3d22b1e230 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:16.534344 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 807/1609] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:16.535411 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859f32-2bb4-43c8-8650-079bfd1c723e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.535702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859f32-2bb4-43c8-8650-079bfd1c723e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.535973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859f32-2bb4-43c8-8650-079bfd1c723e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.540539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 803/1610] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:16.541413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fce453-d265-448a-aaca-7c3d22b1e230 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:16.551430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fce453-d265-448a-aaca-7c3d22b1e230 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:16.557374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d942d51-95a3-48f8-828f-70086c07fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:16.598669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d942d51-95a3-48f8-828f-70086c07fb09 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.598669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d942d51-95a3-48f8-828f-70086c07fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.598669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d942d51-95a3-48f8-828f-70086c07fb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.598669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d942d51-95a3-48f8-828f-70086c07fb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:16.598669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d942d51-95a3-48f8-828f-70086c07fb09 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:16.599306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e8859f32-2bb4-43c8-8650-079bfd1c723e None None] MFA Rules not processed for user `2beaa81ed0ee47c4a0f50f78792a43a7`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:16.599306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e8859f32-2bb4-43c8-8650-079bfd1c723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:16.637527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:16.652703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 808/1611] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:16.653761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859f32-2bb4-43c8-8650-079bfd1c723e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:16.716924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859f32-2bb4-43c8-8650-079bfd1c723e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:16.721154 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973a424-d959-41ed-88e9-2393726b7757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:16.726614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973a424-d959-41ed-88e9-2393726b7757 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.726614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973a424-d959-41ed-88e9-2393726b7757 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.726614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973a424-d959-41ed-88e9-2393726b7757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.769668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 804/1612] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:16 2022] POST /identity/v3/projects => generated 373 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:16.771263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37546b8b-4132-4bb3-aa3e-2f349840a911 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.771730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37546b8b-4132-4bb3-aa3e-2f349840a911 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.772190 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37546b8b-4132-4bb3-aa3e-2f349840a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.784266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973a424-d959-41ed-88e9-2393726b7757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:16.785760 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973a424-d959-41ed-88e9-2393726b7757 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:16.793405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-37546b8b-4132-4bb3-aa3e-2f349840a911 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:16.794618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-37546b8b-4132-4bb3-aa3e-2f349840a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:16.797234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 809/1613] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:16.799544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973a424-d959-41ed-88e9-2393726b7757 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:16.812320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973a424-d959-41ed-88e9-2393726b7757 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:16.830571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:16.886218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75947f-625b-4d0c-8b01-8b9bdbcff3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:16.887095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75947f-625b-4d0c-8b01-8b9bdbcff3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.887382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75947f-625b-4d0c-8b01-8b9bdbcff3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.888539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75947f-625b-4d0c-8b01-8b9bdbcff3fc admin admin] PATH_INFO: `/v3/projects/4f5c9d3264e74b68946e87e7eb19ac7c/users/ba5d1d2ccd8f4e22a0a72d4658b98666/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.905615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 805/1614] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:16.906858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37546b8b-4132-4bb3-aa3e-2f349840a911 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:16.911452 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75947f-625b-4d0c-8b01-8b9bdbcff3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5c9d3264e74b68946e87e7eb19ac7c, user_id=ba5d1d2ccd8f4e22a0a72d4658b98666, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:16.916199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75947f-625b-4d0c-8b01-8b9bdbcff3fc admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:16.923256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37546b8b-4132-4bb3-aa3e-2f349840a911 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:16.928433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14635e-3cd0-4840-ae47-4f106c5a276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:16.929330 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14635e-3cd0-4840-ae47-4f106c5a276f admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:16.929639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14635e-3cd0-4840-ae47-4f106c5a276f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:16.929883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14635e-3cd0-4840-ae47-4f106c5a276f admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:16.930518 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14635e-3cd0-4840-ae47-4f106c5a276f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:16.932565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14635e-3cd0-4840-ae47-4f106c5a276f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:17.040358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 810/1615] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:16 2022] PUT /identity/v3/projects/4f5c9d3264e74b68946e87e7eb19ac7c/users/ba5d1d2ccd8f4e22a0a72d4658b98666/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:17.041766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75947f-625b-4d0c-8b01-8b9bdbcff3fc admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:17.059380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:17.130968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75947f-625b-4d0c-8b01-8b9bdbcff3fc admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:17.136660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00162d-c37d-4832-ba75-0a0626858665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:17.137333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00162d-c37d-4832-ba75-0a0626858665 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.137699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00162d-c37d-4832-ba75-0a0626858665 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.137890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00162d-c37d-4832-ba75-0a0626858665 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.138528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00162d-c37d-4832-ba75-0a0626858665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:17.140689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00162d-c37d-4832-ba75-0a0626858665 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:17.144923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 806/1616] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:16 2022] POST /identity/v3/projects => generated 369 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:17.144923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14635e-3cd0-4840-ae47-4f106c5a276f admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:17.202550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14635e-3cd0-4840-ae47-4f106c5a276f admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:17.206158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258029d-8baf-4476-accd-0319315a3fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:17.206764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258029d-8baf-4476-accd-0319315a3fca service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.207043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258029d-8baf-4476-accd-0319315a3fca service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.207315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258029d-8baf-4476-accd-0319315a3fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.267975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258029d-8baf-4476-accd-0319315a3fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:17.269554 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258029d-8baf-4476-accd-0319315a3fca service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:17.279687 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 807/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:17.280983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82514f3c-248b-42af-92cf-44e2ff88c0d5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.281267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82514f3c-248b-42af-92cf-44e2ff88c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.281539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82514f3c-248b-42af-92cf-44e2ff88c0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.315636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-82514f3c-248b-42af-92cf-44e2ff88c0d5 None None] MFA Rules not processed for user `ba5d1d2ccd8f4e22a0a72d4658b98666`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:17.317058 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-82514f3c-248b-42af-92cf-44e2ff88c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:17.345551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 811/1618] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:17 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:17.346382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00162d-c37d-4832-ba75-0a0626858665 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:17.358199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00162d-c37d-4832-ba75-0a0626858665 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:17.365041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0759c4e-f836-4e5b-8164-af07dd3855e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:17.365613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0759c4e-f836-4e5b-8164-af07dd3855e8 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.365881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0759c4e-f836-4e5b-8164-af07dd3855e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.366146 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0759c4e-f836-4e5b-8164-af07dd3855e8 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.367333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0759c4e-f836-4e5b-8164-af07dd3855e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:17.367756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:17.369840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0759c4e-f836-4e5b-8164-af07dd3855e8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:17.396185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 808/1619] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:17.397078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82514f3c-248b-42af-92cf-44e2ff88c0d5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:17.410190 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82514f3c-248b-42af-92cf-44e2ff88c0d5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:17.415010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfbaa1-570b-40ee-a698-f6727afd1192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:17.415617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfbaa1-570b-40ee-a698-f6727afd1192 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.415897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfbaa1-570b-40ee-a698-f6727afd1192 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.416164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfbaa1-570b-40ee-a698-f6727afd1192 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.416852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfbaa1-570b-40ee-a698-f6727afd1192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:17.418441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfbaa1-570b-40ee-a698-f6727afd1192 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:17.429622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 809/1620] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:17.430428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfbaa1-570b-40ee-a698-f6727afd1192 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:17.442169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfbaa1-570b-40ee-a698-f6727afd1192 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:17.448184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3756ad8-6ce3-4355-bd58-dccaa5e5fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:17.448838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3756ad8-6ce3-4355-bd58-dccaa5e5fdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.449112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3756ad8-6ce3-4355-bd58-dccaa5e5fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.449684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3756ad8-6ce3-4355-bd58-dccaa5e5fdc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.450108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3756ad8-6ce3-4355-bd58-dccaa5e5fdc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:17.452026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3756ad8-6ce3-4355-bd58-dccaa5e5fdc2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:17.517975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 812/1621] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:17 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:17.518919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0759c4e-f836-4e5b-8164-af07dd3855e8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:17.544337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0759c4e-f836-4e5b-8164-af07dd3855e8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:17.561577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6137fa2-1903-4c12-9121-152ae6ffbeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:17.577489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137fa2-1903-4c12-9121-152ae6ffbeac admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.577489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137fa2-1903-4c12-9121-152ae6ffbeac admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.577489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137fa2-1903-4c12-9121-152ae6ffbeac admin admin] PATH_INFO: `/v3/projects/3f74571b681b454cbd8c2e7166a20aa9/users/fb2ef954867547f995d333824d146a9d/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.602723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6137fa2-1903-4c12-9121-152ae6ffbeac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f74571b681b454cbd8c2e7166a20aa9, user_id=fb2ef954867547f995d333824d146a9d, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:17.607909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6137fa2-1903-4c12-9121-152ae6ffbeac admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:17.676111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 810/1622] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:17 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:17.677059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3756ad8-6ce3-4355-bd58-dccaa5e5fdc2 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:17.758843 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3756ad8-6ce3-4355-bd58-dccaa5e5fdc2 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:17.765930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a58b-f21d-4462-8b56-41ce2a83d3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:17.767522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a58b-f21d-4462-8b56-41ce2a83d3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.768531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a58b-f21d-4462-8b56-41ce2a83d3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.769025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a58b-f21d-4462-8b56-41ce2a83d3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.770434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763a58b-f21d-4462-8b56-41ce2a83d3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:17.773269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763a58b-f21d-4462-8b56-41ce2a83d3e2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:17.786734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 811/1623] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:17.788152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a58b-f21d-4462-8b56-41ce2a83d3e2 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:17.799893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a58b-f21d-4462-8b56-41ce2a83d3e2 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:17.806902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b7135-8378-45f4-aaa8-ad029f25e744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:17.808147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7135-8378-45f4-aaa8-ad029f25e744 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.808147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7135-8378-45f4-aaa8-ad029f25e744 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.808379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7135-8378-45f4-aaa8-ad029f25e744 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.808934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b7135-8378-45f4-aaa8-ad029f25e744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:17.810860 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b7135-8378-45f4-aaa8-ad029f25e744 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:17.854720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 813/1624] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:17 2022] PUT /identity/v3/projects/3f74571b681b454cbd8c2e7166a20aa9/users/fb2ef954867547f995d333824d146a9d/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:17.858339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6137fa2-1903-4c12-9121-152ae6ffbeac admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:17.979235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6137fa2-1903-4c12-9121-152ae6ffbeac admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:17.984370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba4ea8-d109-4ed0-a170-a46d8e386760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:17.985137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba4ea8-d109-4ed0-a170-a46d8e386760 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.985359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba4ea8-d109-4ed0-a170-a46d8e386760 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.985780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba4ea8-d109-4ed0-a170-a46d8e386760 admin admin] PATH_INFO: `/v3/projects/516e2d96bdf749a591c9ec18145eee1e/users/46be0f8bac224c369eadcee93440d0be/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.001964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba4ea8-d109-4ed0-a170-a46d8e386760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=516e2d96bdf749a591c9ec18145eee1e, user_id=46be0f8bac224c369eadcee93440d0be, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:18.005873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba4ea8-d109-4ed0-a170-a46d8e386760 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:18.067938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 812/1625] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:17 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:18.069946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b7135-8378-45f4-aaa8-ad029f25e744 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:18.081470 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b7135-8378-45f4-aaa8-ad029f25e744 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:18.087609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec11441-01cc-4823-87f1-de077ee751b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:18.088618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec11441-01cc-4823-87f1-de077ee751b3 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.089186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec11441-01cc-4823-87f1-de077ee751b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.089533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec11441-01cc-4823-87f1-de077ee751b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.091131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec11441-01cc-4823-87f1-de077ee751b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:18.092018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec11441-01cc-4823-87f1-de077ee751b3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:18.109159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 813/1626] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:18.111117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec11441-01cc-4823-87f1-de077ee751b3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:18.127458 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec11441-01cc-4823-87f1-de077ee751b3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:18.132708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e1a7d-983e-4da2-800c-216571d91805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:18.137690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e1a7d-983e-4da2-800c-216571d91805 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.137690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e1a7d-983e-4da2-800c-216571d91805 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.137690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e1a7d-983e-4da2-800c-216571d91805 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.137690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e1a7d-983e-4da2-800c-216571d91805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:18.137690 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e1a7d-983e-4da2-800c-216571d91805 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:18.153661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 814/1627] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:18.154759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e1a7d-983e-4da2-800c-216571d91805 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:18.167542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e1a7d-983e-4da2-800c-216571d91805 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:18.173901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d01135-b5ce-4911-8553-7b7020be4ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:18.174798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d01135-b5ce-4911-8553-7b7020be4ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.175084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d01135-b5ce-4911-8553-7b7020be4ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.175360 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d01135-b5ce-4911-8553-7b7020be4ffa admin admin] PATH_INFO: `/v3/projects/3f74571b681b454cbd8c2e7166a20aa9/users/fb2ef954867547f995d333824d146a9d/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.177313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d01135-b5ce-4911-8553-7b7020be4ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f74571b681b454cbd8c2e7166a20aa9, user_id=fb2ef954867547f995d333824d146a9d, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:18.180177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 814/1628] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:17 2022] PUT /identity/v3/projects/516e2d96bdf749a591c9ec18145eee1e/users/46be0f8bac224c369eadcee93440d0be/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:18.182789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d01135-b5ce-4911-8553-7b7020be4ffa admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:18.182931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba4ea8-d109-4ed0-a170-a46d8e386760 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:18.201400 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 815/1629] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:18 2022] PUT /identity/v3/projects/3f74571b681b454cbd8c2e7166a20aa9/users/fb2ef954867547f995d333824d146a9d/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:18.203051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d01135-b5ce-4911-8553-7b7020be4ffa admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:18.289537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:18.295061 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d01135-b5ce-4911-8553-7b7020be4ffa admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:18.300393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4ed29-c34b-4181-b08d-3b5f0d811fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:18.301198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4ed29-c34b-4181-b08d-3b5f0d811fdf admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.301613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4ed29-c34b-4181-b08d-3b5f0d811fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.301958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4ed29-c34b-4181-b08d-3b5f0d811fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.302727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4ed29-c34b-4181-b08d-3b5f0d811fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:18.305787 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4ed29-c34b-4181-b08d-3b5f0d811fdf admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:18.323251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 816/1630] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:18.323251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33aa71-2bfc-4d74-bdb0-cd27f73a38bb None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.323251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33aa71-2bfc-4d74-bdb0-cd27f73a38bb None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.323251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33aa71-2bfc-4d74-bdb0-cd27f73a38bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.323692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba4ea8-d109-4ed0-a170-a46d8e386760 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:18.334664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf796e-f207-4256-a683-5943b7d38e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:18.335673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf796e-f207-4256-a683-5943b7d38e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.335958 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf796e-f207-4256-a683-5943b7d38e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.336236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf796e-f207-4256-a683-5943b7d38e26 admin admin] PATH_INFO: `/v3/projects/129ca08207c94a9ca81f54cc61228c8e/users/5e6f1a22b112401eb0c03a964ee4f7db/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.356390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-2c33aa71-2bfc-4d74-bdb0-cd27f73a38bb None None] MFA Rules not processed for user `fb2ef954867547f995d333824d146a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:18.357659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2c33aa71-2bfc-4d74-bdb0-cd27f73a38bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:18.375358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf796e-f207-4256-a683-5943b7d38e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129ca08207c94a9ca81f54cc61228c8e, user_id=5e6f1a22b112401eb0c03a964ee4f7db, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:18.378429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf796e-f207-4256-a683-5943b7d38e26 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:18.524660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 817/1631] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:18.525618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33aa71-2bfc-4d74-bdb0-cd27f73a38bb None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:18.536626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33aa71-2bfc-4d74-bdb0-cd27f73a38bb None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:18.541258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7fee9-9016-4826-938e-ebf406317b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:18.541941 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7fee9-9016-4826-938e-ebf406317b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.542220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7fee9-9016-4826-938e-ebf406317b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.542497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7fee9-9016-4826-938e-ebf406317b01 admin admin] PATH_INFO: `/v3/projects/516e2d96bdf749a591c9ec18145eee1e/users/46be0f8bac224c369eadcee93440d0be/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.544756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7fee9-9016-4826-938e-ebf406317b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=516e2d96bdf749a591c9ec18145eee1e, user_id=46be0f8bac224c369eadcee93440d0be, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:18.547320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7fee9-9016-4826-938e-ebf406317b01 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:18.572983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 818/1632] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:18 2022] PUT /identity/v3/projects/516e2d96bdf749a591c9ec18145eee1e/users/46be0f8bac224c369eadcee93440d0be/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:18.572983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7fee9-9016-4826-938e-ebf406317b01 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:18.622137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 815/1633] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:18 2022] PUT /identity/v3/projects/129ca08207c94a9ca81f54cc61228c8e/users/5e6f1a22b112401eb0c03a964ee4f7db/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:18.624823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed17d7-1c48-4eff-8904-c1ccc9c9e3f0 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.624823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed17d7-1c48-4eff-8904-c1ccc9c9e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.624823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed17d7-1c48-4eff-8904-c1ccc9c9e3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.635908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7fee9-9016-4826-938e-ebf406317b01 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:18.706883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-73ed17d7-1c48-4eff-8904-c1ccc9c9e3f0 None None] MFA Rules not processed for user `46be0f8bac224c369eadcee93440d0be`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:18.707525 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe22122-826e-4478-856f-3ed5c3dfae2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:18.708156 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22122-826e-4478-856f-3ed5c3dfae2b service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.708431 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22122-826e-4478-856f-3ed5c3dfae2b service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.708740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22122-826e-4478-856f-3ed5c3dfae2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.709461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-73ed17d7-1c48-4eff-8904-c1ccc9c9e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:18.801659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe22122-826e-4478-856f-3ed5c3dfae2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:18.805207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe22122-826e-4478-856f-3ed5c3dfae2b service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:18.819196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 819/1634] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:18.820930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe22122-826e-4478-856f-3ed5c3dfae2b service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:18.852002 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 816/1635] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:18.875549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed17d7-1c48-4eff-8904-c1ccc9c9e3f0 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:18.889052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed17d7-1c48-4eff-8904-c1ccc9c9e3f0 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:18.897645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501be966-1ec3-4c1b-8761-f7f77e43adbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:18.909756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501be966-1ec3-4c1b-8761-f7f77e43adbe service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.910203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501be966-1ec3-4c1b-8761-f7f77e43adbe service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.910582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501be966-1ec3-4c1b-8761-f7f77e43adbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.945946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501be966-1ec3-4c1b-8761-f7f77e43adbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:18.948816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501be966-1ec3-4c1b-8761-f7f77e43adbe service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:19.624017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe22122-826e-4478-856f-3ed5c3dfae2b service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:19.631913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 817/1636] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:57:19.633553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4192b-8c00-41ac-98dc-3fce1ebc8789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:19.633553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4192b-8c00-41ac-98dc-3fce1ebc8789 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:19.633553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4192b-8c00-41ac-98dc-3fce1ebc8789 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:19.633553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4192b-8c00-41ac-98dc-3fce1ebc8789 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:19.634358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4192b-8c00-41ac-98dc-3fce1ebc8789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:19.634358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4192b-8c00-41ac-98dc-3fce1ebc8789 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:19.635150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501be966-1ec3-4c1b-8761-f7f77e43adbe service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:19.635576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 820/1637] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:19.636152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501be966-1ec3-4c1b-8761-f7f77e43adbe service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:19.636152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de20a80-78bf-4b48-a785-e2e193f2653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:19.636152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de20a80-78bf-4b48-a785-e2e193f2653b admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:19.636152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de20a80-78bf-4b48-a785-e2e193f2653b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:19.636850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de20a80-78bf-4b48-a785-e2e193f2653b admin admin] PATH_INFO: `/v3/projects/129ca08207c94a9ca81f54cc61228c8e/users/5e6f1a22b112401eb0c03a964ee4f7db/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:19.636850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de20a80-78bf-4b48-a785-e2e193f2653b admin admin] RBAC: Authorizing `identity:create_grant(project_id=129ca08207c94a9ca81f54cc61228c8e, user_id=5e6f1a22b112401eb0c03a964ee4f7db, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:19.636850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de20a80-78bf-4b48-a785-e2e193f2653b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:19.636850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 818/1638] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:19 2022] PUT /identity/v3/projects/129ca08207c94a9ca81f54cc61228c8e/users/5e6f1a22b112401eb0c03a964ee4f7db/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:57:19.637181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395e5b3-703a-4a13-a6e1-99d633ca234f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:19.637181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395e5b3-703a-4a13-a6e1-99d633ca234f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:19.637181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395e5b3-703a-4a13-a6e1-99d633ca234f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:19.637181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b395e5b3-703a-4a13-a6e1-99d633ca234f None None] MFA Rules not processed for user `5e6f1a22b112401eb0c03a964ee4f7db`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:19.637181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b395e5b3-703a-4a13-a6e1-99d633ca234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:19.637181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 821/1639] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:19.637657 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de20a80-78bf-4b48-a785-e2e193f2653b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:19.637951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:19.644425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de20a80-78bf-4b48-a785-e2e193f2653b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:19.648806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0908045-4859-4656-a095-afb6f3d231bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:19.651125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0908045-4859-4656-a095-afb6f3d231bd service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:19.651125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0908045-4859-4656-a095-afb6f3d231bd service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:19.651125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0908045-4859-4656-a095-afb6f3d231bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:19.667863 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0908045-4859-4656-a095-afb6f3d231bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:19.669732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0908045-4859-4656-a095-afb6f3d231bd service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:19.681331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 819/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:19.938499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395e5b3-703a-4a13-a6e1-99d633ca234f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:19.949738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395e5b3-703a-4a13-a6e1-99d633ca234f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:19.961195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fcfc6-dce6-41c9-96ef-84ec28f47c5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:19.963241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fcfc6-dce6-41c9-96ef-84ec28f47c5d service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:19.963693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fcfc6-dce6-41c9-96ef-84ec28f47c5d service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:19.970355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fcfc6-dce6-41c9-96ef-84ec28f47c5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:20.065543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fcfc6-dce6-41c9-96ef-84ec28f47c5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:20.067043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fcfc6-dce6-41c9-96ef-84ec28f47c5d service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:20.077883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 822/1641] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:20.830768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0908045-4859-4656-a095-afb6f3d231bd service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:20.846762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0908045-4859-4656-a095-afb6f3d231bd service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:20.851450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0578a-6e6c-40df-a681-50947842093c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:20.852253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0578a-6e6c-40df-a681-50947842093c service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:20.852573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0578a-6e6c-40df-a681-50947842093c service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:20.853081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0578a-6e6c-40df-a681-50947842093c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:20.934812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0578a-6e6c-40df-a681-50947842093c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:20.937321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0578a-6e6c-40df-a681-50947842093c service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:20.972367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 820/1642] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:22.305758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:22.306999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e014b5-122a-43dd-8263-e650904e2cb6 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:22.306999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e014b5-122a-43dd-8263-e650904e2cb6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:22.306999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e014b5-122a-43dd-8263-e650904e2cb6 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:22.306999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 823/1643] 10.222.0.18 () {54 vars in 962 bytes} [Mon Aug 22 15:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:22.307640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21ed67-af62-457f-bd26-503b8c14e503 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:22.307640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21ed67-af62-457f-bd26-503b8c14e503 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:22.307769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21ed67-af62-457f-bd26-503b8c14e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:22.391300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7f21ed67-af62-457f-bd26-503b8c14e503 None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:22.393972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7f21ed67-af62-457f-bd26-503b8c14e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:22.563635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 821/1644] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Aug 22 15:57:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:22.566022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a87083-fbcb-4527-8373-c82dfd7f01c6 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:22.566308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a87083-fbcb-4527-8373-c82dfd7f01c6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:22.566580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a87083-fbcb-4527-8373-c82dfd7f01c6 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:22.568158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 824/1645] 10.222.0.18 () {54 vars in 912 bytes} [Mon Aug 22 15:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:22.575832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557fa31-2536-4caa-80b7-e020e3ff06e0 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:22.576021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557fa31-2536-4caa-80b7-e020e3ff06e0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:22.576328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557fa31-2536-4caa-80b7-e020e3ff06e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:22.643937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-0557fa31-2536-4caa-80b7-e020e3ff06e0 None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:22.646990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0557fa31-2536-4caa-80b7-e020e3ff06e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:22.664908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 822/1646] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 15:57:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:22.826423 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a87083-fbcb-4527-8373-c82dfd7f01c6 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:22.849528 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a87083-fbcb-4527-8373-c82dfd7f01c6 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:22.869684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fccaf-9a93-4b9e-b5eb-9803dfbf14d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:22.870602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fccaf-9a93-4b9e-b5eb-9803dfbf14d0 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:22.872642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fccaf-9a93-4b9e-b5eb-9803dfbf14d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:22.872642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fccaf-9a93-4b9e-b5eb-9803dfbf14d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:22.913691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fccaf-9a93-4b9e-b5eb-9803dfbf14d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:22.913691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fccaf-9a93-4b9e-b5eb-9803dfbf14d0 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:22.952530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 825/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:23.219867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:26.143592 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4e3a-0ab7-4f98-a391-a47f8eba3c99 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:26.144949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4e3a-0ab7-4f98-a391-a47f8eba3c99 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:26.145525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4e3a-0ab7-4f98-a391-a47f8eba3c99 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:26.147929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 823/1648] 10.222.0.18 () {54 vars in 962 bytes} [Mon Aug 22 15:57:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:26.163609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a29cc-0c1b-436c-8afd-1c0f85c600a1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:26.164629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a29cc-0c1b-436c-8afd-1c0f85c600a1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:26.165277 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a29cc-0c1b-436c-8afd-1c0f85c600a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:26.243234 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-002a29cc-0c1b-436c-8afd-1c0f85c600a1 None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:26.246719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-002a29cc-0c1b-436c-8afd-1c0f85c600a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:26.275442 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 826/1649] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Aug 22 15:57:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:26.282181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1492b-9a85-41e5-8d8d-13ed60d85bac None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:26.282536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1492b-9a85-41e5-8d8d-13ed60d85bac None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:26.282907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1492b-9a85-41e5-8d8d-13ed60d85bac None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:26.284693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 824/1650] 10.222.0.18 () {54 vars in 912 bytes} [Mon Aug 22 15:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:26.295177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39653765-6233-423f-8f62-5bd9ed511db7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:26.298550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39653765-6233-423f-8f62-5bd9ed511db7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:26.298550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39653765-6233-423f-8f62-5bd9ed511db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:26.369276 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-39653765-6233-423f-8f62-5bd9ed511db7 None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:26.373057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-39653765-6233-423f-8f62-5bd9ed511db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:26.421314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 827/1651] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 15:57:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:26.447115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1492b-9a85-41e5-8d8d-13ed60d85bac None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:26.464452 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1492b-9a85-41e5-8d8d-13ed60d85bac None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:26.477038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e716553-a638-4175-ab38-264f99b6eeda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:26.478920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e716553-a638-4175-ab38-264f99b6eeda service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:26.480245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e716553-a638-4175-ab38-264f99b6eeda service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:26.481733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e716553-a638-4175-ab38-264f99b6eeda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:26.512529 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e716553-a638-4175-ab38-264f99b6eeda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:26.517366 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e716553-a638-4175-ab38-264f99b6eeda service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:26.535396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 825/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:26.819665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:28.103959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63420f08-0974-465b-8e35-bde7c4afec33 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:28.105313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63420f08-0974-465b-8e35-bde7c4afec33 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:28.105863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63420f08-0974-465b-8e35-bde7c4afec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:28.146374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-63420f08-0974-465b-8e35-bde7c4afec33 None None] MFA Rules not processed for user `c4415fe3e3704fde82f2dea0622d725f`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:28.148248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-63420f08-0974-465b-8e35-bde7c4afec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:28.303819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 828/1653] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:28.315190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e716553-a638-4175-ab38-264f99b6eeda service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:28.346349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e716553-a638-4175-ab38-264f99b6eeda service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:28.358689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39140-4ea8-4a9b-8311-39650f4a03f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:28.359457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39140-4ea8-4a9b-8311-39650f4a03f7 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:28.360001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39140-4ea8-4a9b-8311-39650f4a03f7 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:28.361159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39140-4ea8-4a9b-8311-39650f4a03f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:28.381229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d39140-4ea8-4a9b-8311-39650f4a03f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:28.383451 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d39140-4ea8-4a9b-8311-39650f4a03f7 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:28.428931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 826/1654] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:31.121854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc100d22-d501-4001-95f2-ae50d80f2eb6 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:31.123287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc100d22-d501-4001-95f2-ae50d80f2eb6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:31.123730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc100d22-d501-4001-95f2-ae50d80f2eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:31.169673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a8b4b-17ea-4002-a4e5-5e96516df849 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:31.170176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a8b4b-17ea-4002-a4e5-5e96516df849 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:31.170293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a8b4b-17ea-4002-a4e5-5e96516df849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:31.205473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-fc100d22-d501-4001-95f2-ae50d80f2eb6 None None] MFA Rules not processed for user `511ddb50fc25452fac22ed8396542f96`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:31.207293 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fc100d22-d501-4001-95f2-ae50d80f2eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:31.280095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-680a8b4b-17ea-4002-a4e5-5e96516df849 None None] MFA Rules not processed for user `1e513898018544c7924d592c40f7dd54`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:31.281616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-680a8b4b-17ea-4002-a4e5-5e96516df849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:31.473324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 829/1655] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:31.488386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc100d22-d501-4001-95f2-ae50d80f2eb6 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:31.515048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc100d22-d501-4001-95f2-ae50d80f2eb6 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:31.528565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7c83a-8741-4528-a9b3-72c7a0791cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:31.529581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7c83a-8741-4528-a9b3-72c7a0791cd6 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:31.530167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7c83a-8741-4528-a9b3-72c7a0791cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:31.534140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7c83a-8741-4528-a9b3-72c7a0791cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:31.549782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7c83a-8741-4528-a9b3-72c7a0791cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:31.551814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7c83a-8741-4528-a9b3-72c7a0791cd6 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:31.575294 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 830/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:31.583328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 827/1657] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:31.599631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7c83a-8741-4528-a9b3-72c7a0791cd6 service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:31.676722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:31.754720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a8b4b-17ea-4002-a4e5-5e96516df849 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:31.764979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:31.765985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7c83a-8741-4528-a9b3-72c7a0791cd6 service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:31.777679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a8b4b-17ea-4002-a4e5-5e96516df849 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:31.780716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:31.782658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:31.783081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:31.783793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] PATH_INFO: `/v3/users/2beaa81ed0ee47c4a0f50f78792a43a7` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:31.788487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2beaa81ed0ee47c4a0f50f78792a43a7)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:31.793434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:31.796110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b388d8-41fb-49d3-b58a-51a5c9eda13d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:31.797230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b388d8-41fb-49d3-b58a-51a5c9eda13d service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:31.797653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b388d8-41fb-49d3-b58a-51a5c9eda13d service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:31.799128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b388d8-41fb-49d3-b58a-51a5c9eda13d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:31.819638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b388d8-41fb-49d3-b58a-51a5c9eda13d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:31.822592 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b388d8-41fb-49d3-b58a-51a5c9eda13d service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:31.872545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 828/1658] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:32.224619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2beaa81ed0ee47c4a0f50f78792a43a7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:32.224619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2beaa81ed0ee47c4a0f50f78792a43a7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:32.780763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2beaa81ed0ee47c4a0f50f78792a43a7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:32.791111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2beaa81ed0ee47c4a0f50f78792a43a7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:32.794259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2beaa81ed0ee47c4a0f50f78792a43a7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:32.855203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 831/1659] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:57:31 2022] DELETE /identity/v3/users/2beaa81ed0ee47c4a0f50f78792a43a7 => generated 0 bytes in 1276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:32.856786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987ff17-3432-4201-9fba-d4f9734a86d5 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:32.857776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987ff17-3432-4201-9fba-d4f9734a86d5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:32.859498 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987ff17-3432-4201-9fba-d4f9734a86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:32.903913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-f987ff17-3432-4201-9fba-d4f9734a86d5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:32.906046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f987ff17-3432-4201-9fba-d4f9734a86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:33.091519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 829/1660] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:57:33.126837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:33.132743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:33.319850 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242adb9c-d9c1-42fa-a84e-2e42b83fffe7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:33.337012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c4f62-d3d5-44c7-a23f-da5cf7761d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:33.337012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c4f62-d3d5-44c7-a23f-da5cf7761d06 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:33.337012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c4f62-d3d5-44c7-a23f-da5cf7761d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:33.337012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c4f62-d3d5-44c7-a23f-da5cf7761d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:33.392428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c4f62-d3d5-44c7-a23f-da5cf7761d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:33.399473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c4f62-d3d5-44c7-a23f-da5cf7761d06 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:33.429249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 832/1661] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:34.499416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987ff17-3432-4201-9fba-d4f9734a86d5 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:34.501031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f987ff17-3432-4201-9fba-d4f9734a86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:34.534842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987ff17-3432-4201-9fba-d4f9734a86d5 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:34.552711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:34.554838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:34.555419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:34.556080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] PATH_INFO: `/v3/projects/20c8e459f89d4bea956fc5c3a6bbb84c` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:34.558612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c8e459f89d4bea956fc5c3a6bbb84c)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:34.561941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:34.607672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69d05b-becb-4ff6-b2c2-ca709692564a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:34.608239 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69d05b-becb-4ff6-b2c2-ca709692564a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:34.610220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69d05b-becb-4ff6-b2c2-ca709692564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:34.676613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-dc69d05b-becb-4ff6-b2c2-ca709692564a None None] MFA Rules not processed for user `b6bc6eecd2af449894f93233b8807544`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:34.680023 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-dc69d05b-becb-4ff6-b2c2-ca709692564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:34.753503 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:34.835704 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 833/1662] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:34.847151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfba77-a8ec-41c2-8d8b-f85861213993 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:34.847508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfba77-a8ec-41c2-8d8b-f85861213993 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:34.847706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfba77-a8ec-41c2-8d8b-f85861213993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:34.861809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c8e459f89d4bea956fc5c3a6bbb84c', 'request_id': 'req-15614f54-2520-453d-9fb8-e8ecd08c2c84'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:34.886970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-eacfba77-a8ec-41c2-8d8b-f85861213993 None None] MFA Rules not processed for user `b6bc6eecd2af449894f93233b8807544`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:34.888215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-eacfba77-a8ec-41c2-8d8b-f85861213993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:35.007084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c8e459f89d4bea956fc5c3a6bbb84c', 'request_id': 'req-15614f54-2520-453d-9fb8-e8ecd08c2c84'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:35.024886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c8e459f89d4bea956fc5c3a6bbb84c', 'request_id': 'req-15614f54-2520-453d-9fb8-e8ecd08c2c84'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:35.048175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 834/1663] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:57:35.059576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfba77-a8ec-41c2-8d8b-f85861213993 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:35.061829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-eacfba77-a8ec-41c2-8d8b-f85861213993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:35.067541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] The token cache is being invalidate because project 20c8e459f89d4bea956fc5c3a6bbb84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:57:35.076685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:35.078367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:35.084909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 830/1664] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:57:34 2022] DELETE /identity/v3/projects/20c8e459f89d4bea956fc5c3a6bbb84c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:35.093911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:35.098105 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:35.285036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfba77-a8ec-41c2-8d8b-f85861213993 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:35.312595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a60020-92b3-420a-b18d-2348e0aeef38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:35.313223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60020-92b3-420a-b18d-2348e0aeef38 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:35.313509 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60020-92b3-420a-b18d-2348e0aeef38 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:35.313789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60020-92b3-420a-b18d-2348e0aeef38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:35.321086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e4a60020-92b3-420a-b18d-2348e0aeef38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:35.351599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a60020-92b3-420a-b18d-2348e0aeef38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:35.359046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a60020-92b3-420a-b18d-2348e0aeef38 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:35.393273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15614f54-2520-453d-9fb8-e8ecd08c2c84 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:35.398800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 835/1665] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:57:35.412712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:35.413080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:35.413361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:35.413639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] PATH_INFO: `/v3/users/46be0f8bac224c369eadcee93440d0be` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:35.417745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46be0f8bac224c369eadcee93440d0be)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:35.419431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: WARNING py.warnings [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:57:35.419431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: warnings.warn(msg) Aug 22 15:57:35.419431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: Aug 22 15:57:35.422736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:35.458783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:35.769796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46be0f8bac224c369eadcee93440d0be'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:35.852954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46be0f8bac224c369eadcee93440d0be'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:36.036147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46be0f8bac224c369eadcee93440d0be'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:36.039248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46be0f8bac224c369eadcee93440d0be'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:36.066286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d60e39ff-b862-4394-b4d3-e80fab19cc59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46be0f8bac224c369eadcee93440d0be'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:36.074010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 831/1666] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:57:35 2022] DELETE /identity/v3/users/46be0f8bac224c369eadcee93440d0be => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:36.251287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66401d5b-3dfe-434e-aee6-870fe0a60167 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:36.252263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66401d5b-3dfe-434e-aee6-870fe0a60167 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:36.252263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66401d5b-3dfe-434e-aee6-870fe0a60167 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:36.253250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 836/1667] 10.222.0.18 () {54 vars in 912 bytes} [Mon Aug 22 15:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:36.262110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f0c4b-c14a-4da5-86f2-e06f60163cd0 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:36.263509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f0c4b-c14a-4da5-86f2-e06f60163cd0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:36.263799 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f0c4b-c14a-4da5-86f2-e06f60163cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:36.352739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e03f0c4b-c14a-4da5-86f2-e06f60163cd0 None None] MFA Rules not processed for user `90324fa56d0743699f2fddd17fb630dd`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:36.354622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e03f0c4b-c14a-4da5-86f2-e06f60163cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:36.495019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 832/1668] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:36.527270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66401d5b-3dfe-434e-aee6-870fe0a60167 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:36.529281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-66401d5b-3dfe-434e-aee6-870fe0a60167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:36.554812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66401d5b-3dfe-434e-aee6-870fe0a60167 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:36.561186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc9baa-b571-4d57-a8ad-1ce21cec4cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:36.561877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc9baa-b571-4d57-a8ad-1ce21cec4cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:36.562157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc9baa-b571-4d57-a8ad-1ce21cec4cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:36.562428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc9baa-b571-4d57-a8ad-1ce21cec4cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:36.571924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc9baa-b571-4d57-a8ad-1ce21cec4cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:36.573756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc9baa-b571-4d57-a8ad-1ce21cec4cd6 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:36.594060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 837/1669] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:36.706015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5012c-5121-4369-873c-6d628c71c2a2 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:36.706816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5012c-5121-4369-873c-6d628c71c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:36.706816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5012c-5121-4369-873c-6d628c71c2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:36.741878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-51e5012c-5121-4369-873c-6d628c71c2a2 None None] MFA Rules not processed for user `c4415fe3e3704fde82f2dea0622d725f`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:36.742999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-51e5012c-5121-4369-873c-6d628c71c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:36.911724 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 833/1670] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:37.407437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226493-37b6-44cf-8264-b03b3b8b963b None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:37.407953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226493-37b6-44cf-8264-b03b3b8b963b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:37.407953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226493-37b6-44cf-8264-b03b3b8b963b None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:37.409349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 838/1671] 10.222.0.18 () {54 vars in 912 bytes} [Mon Aug 22 15:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:37.415527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a49ff9-a4ef-49cb-9fe8-543457e0027a None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:37.415815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a49ff9-a4ef-49cb-9fe8-543457e0027a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:37.416137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a49ff9-a4ef-49cb-9fe8-543457e0027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:37.451130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-82a49ff9-a4ef-49cb-9fe8-543457e0027a None None] MFA Rules not processed for user `90324fa56d0743699f2fddd17fb630dd`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:37.463599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-82a49ff9-a4ef-49cb-9fe8-543457e0027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:37.474276 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62226493-37b6-44cf-8264-b03b3b8b963b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:37.476338 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-62226493-37b6-44cf-8264-b03b3b8b963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:37.521898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 834/1672] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:37.538280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a49ff9-a4ef-49cb-9fe8-543457e0027a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:37.550194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a49ff9-a4ef-49cb-9fe8-543457e0027a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:37.563643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aceb89-ba4a-49e5-a4d3-8adbcb19e289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:37.564308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aceb89-ba4a-49e5-a4d3-8adbcb19e289 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:37.569751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aceb89-ba4a-49e5-a4d3-8adbcb19e289 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:37.570123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aceb89-ba4a-49e5-a4d3-8adbcb19e289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:37.599828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aceb89-ba4a-49e5-a4d3-8adbcb19e289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:37.601544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aceb89-ba4a-49e5-a4d3-8adbcb19e289 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:37.645435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 835/1673] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:37.675289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84a67-edb5-4d48-9e6b-847a14a8676e None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:37.675616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84a67-edb5-4d48-9e6b-847a14a8676e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:37.675940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84a67-edb5-4d48-9e6b-847a14a8676e None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:37.677501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 836/1674] 10.222.0.18 () {54 vars in 961 bytes} [Mon Aug 22 15:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:37.687761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f906c-4cbe-410e-8b16-029641d52193 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:37.687761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f906c-4cbe-410e-8b16-029641d52193 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:37.687761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f906c-4cbe-410e-8b16-029641d52193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:37.785655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3d9f906c-4cbe-410e-8b16-029641d52193 None None] MFA Rules not processed for user `9ecb4e7e9e3042adadd93229f8456eca`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:37.799908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3d9f906c-4cbe-410e-8b16-029641d52193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:37.819968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62226493-37b6-44cf-8264-b03b3b8b963b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:37.849313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:37.850775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:37.852270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:37.853419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] PATH_INFO: `/v3/projects/516e2d96bdf749a591c9ec18145eee1e` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:37.855646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=516e2d96bdf749a591c9ec18145eee1e)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:37.859427 dv-cinder-842541-5-smb devstack@keystone.service[98421]: WARNING py.warnings [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:57:37.859427 dv-cinder-842541-5-smb devstack@keystone.service[98421]: warnings.warn(msg) Aug 22 15:57:37.859427 dv-cinder-842541-5-smb devstack@keystone.service[98421]: Aug 22 15:57:37.870210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:38.094326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 837/1675] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Aug 22 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 22 15:57:38.096170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f906c-4cbe-410e-8b16-029641d52193 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:38.099302 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3d9f906c-4cbe-410e-8b16-029641d52193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:38.122024 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f906c-4cbe-410e-8b16-029641d52193 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:38.129387 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:38.130354 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:38.131599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:38.132082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] PATH_INFO: `/v3/users/061658e3bb2541bb905b48f071ff5668` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:38.135260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=061658e3bb2541bb905b48f071ff5668)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:38.138306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:38.203076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516e2d96bdf749a591c9ec18145eee1e', 'request_id': 'req-3fda71ef-bfd8-42c6-87e3-42ae15829404'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:38.251308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516e2d96bdf749a591c9ec18145eee1e', 'request_id': 'req-3fda71ef-bfd8-42c6-87e3-42ae15829404'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:38.291014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516e2d96bdf749a591c9ec18145eee1e', 'request_id': 'req-3fda71ef-bfd8-42c6-87e3-42ae15829404'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:38.447484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] The token cache is being invalidate because project 516e2d96bdf749a591c9ec18145eee1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:57:38.448949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:38.450845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3fda71ef-bfd8-42c6-87e3-42ae15829404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:38.456434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 839/1676] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:57:37 2022] DELETE /identity/v3/projects/516e2d96bdf749a591c9ec18145eee1e => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:38.459647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931bf3d-cbd9-44dd-9ad3-bf06c2d4de49 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:38.463617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931bf3d-cbd9-44dd-9ad3-bf06c2d4de49 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:38.463906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931bf3d-cbd9-44dd-9ad3-bf06c2d4de49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:38.497617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e931bf3d-cbd9-44dd-9ad3-bf06c2d4de49 None None] MFA Rules not processed for user `511ddb50fc25452fac22ed8396542f96`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:38.500801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e931bf3d-cbd9-44dd-9ad3-bf06c2d4de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:38.521528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061658e3bb2541bb905b48f071ff5668'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:38.572959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061658e3bb2541bb905b48f071ff5668'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:38.648805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 840/1677] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:38.651750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931bf3d-cbd9-44dd-9ad3-bf06c2d4de49 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:38.658463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e931bf3d-cbd9-44dd-9ad3-bf06c2d4de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:38.676242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061658e3bb2541bb905b48f071ff5668'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:38.677365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061658e3bb2541bb905b48f071ff5668'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:38.692907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-72fa93ac-5a49-400c-8b67-9a18fd8bcee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061658e3bb2541bb905b48f071ff5668'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:38.715538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 838/1678] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:57:38 2022] DELETE /identity/v3/users/061658e3bb2541bb905b48f071ff5668 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:38.720599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e577c7-e23c-4f6c-b6c7-f2c29086e6aa None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:38.727352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e577c7-e23c-4f6c-b6c7-f2c29086e6aa None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:38.727639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e577c7-e23c-4f6c-b6c7-f2c29086e6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:38.770194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d6e577c7-e23c-4f6c-b6c7-f2c29086e6aa None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:38.775240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d6e577c7-e23c-4f6c-b6c7-f2c29086e6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:38.795417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931bf3d-cbd9-44dd-9ad3-bf06c2d4de49 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:38.876660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:38.881378 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 839/1679] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:38.882564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e577c7-e23c-4f6c-b6c7-f2c29086e6aa None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:38.891079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d6e577c7-e23c-4f6c-b6c7-f2c29086e6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:38.906715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e577c7-e23c-4f6c-b6c7-f2c29086e6aa None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:38.916454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:38.929090 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:38.929792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:38.930211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] PATH_INFO: `/v3/users/ba5d1d2ccd8f4e22a0a72d4658b98666` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:38.932015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5d1d2ccd8f4e22a0a72d4658b98666)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:38.934386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:38.972442 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6436eb4-f312-4614-b3ef-6297b873c829 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecb4e7e9e3042adadd93229f8456eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:38.973102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6436eb4-f312-4614-b3ef-6297b873c829 service placement] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:38.973391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6436eb4-f312-4614-b3ef-6297b873c829 service placement] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:38.973935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6436eb4-f312-4614-b3ef-6297b873c829 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:38.985710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c6436eb4-f312-4614-b3ef-6297b873c829 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:39.013238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6436eb4-f312-4614-b3ef-6297b873c829 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:39.015927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6436eb4-f312-4614-b3ef-6297b873c829 service placement] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:39.031870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 841/1680] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:39.034497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f6ea9-e645-4bf6-a3ec-d2cf87ef8438 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:39.035015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f6ea9-e645-4bf6-a3ec-d2cf87ef8438 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:39.035390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f6ea9-e645-4bf6-a3ec-d2cf87ef8438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:39.069743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-893f6ea9-e645-4bf6-a3ec-d2cf87ef8438 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:39.071299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-893f6ea9-e645-4bf6-a3ec-d2cf87ef8438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:39.101401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 842/1681] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:39.102984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23570f-821c-4746-b2f7-babeda192689 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:39.103380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23570f-821c-4746-b2f7-babeda192689 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:39.103578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23570f-821c-4746-b2f7-babeda192689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:39.163643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-1b23570f-821c-4746-b2f7-babeda192689 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:39.165245 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1b23570f-821c-4746-b2f7-babeda192689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:39.204267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 843/1682] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:39.205362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23570f-821c-4746-b2f7-babeda192689 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:39.207113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1b23570f-821c-4746-b2f7-babeda192689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:39.277690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5d1d2ccd8f4e22a0a72d4658b98666'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:39.311211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5d1d2ccd8f4e22a0a72d4658b98666'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:39.409996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23570f-821c-4746-b2f7-babeda192689 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:39.422581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bb123-3243-4084-934c-1b3bd3758d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:39.430370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5d1d2ccd8f4e22a0a72d4658b98666'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:39.431199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5d1d2ccd8f4e22a0a72d4658b98666'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:39.433315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bb123-3243-4084-934c-1b3bd3758d67 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:39.434589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bb123-3243-4084-934c-1b3bd3758d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:39.434589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bb123-3243-4084-934c-1b3bd3758d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:39.446845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-dd8bb123-3243-4084-934c-1b3bd3758d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:39.451539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5d1d2ccd8f4e22a0a72d4658b98666'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:39.481273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 840/1683] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:57:38 2022] DELETE /identity/v3/users/ba5d1d2ccd8f4e22a0a72d4658b98666 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:39.482632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:39.488642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bb123-3243-4084-934c-1b3bd3758d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:39.490768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:39.494725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bb123-3243-4084-934c-1b3bd3758d67 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:39.549513 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 844/1684] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:39.551762 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4455-6ad3-4212-a975-d04123ccb97f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:39.552267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4455-6ad3-4212-a975-d04123ccb97f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:39.553114 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4455-6ad3-4212-a975-d04123ccb97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:39.582662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-958c4455-6ad3-4212-a975-d04123ccb97f None None] MFA Rules not processed for user `1e513898018544c7924d592c40f7dd54`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:39.584798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-958c4455-6ad3-4212-a975-d04123ccb97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:39.645151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:39.771744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e7030-c602-4938-a859-3be5ce838a13 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:39.784893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f850e6-0a3f-48c1-b501-2fe091f7c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:39.786640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f850e6-0a3f-48c1-b501-2fe091f7c4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:39.788691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f850e6-0a3f-48c1-b501-2fe091f7c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:39.789140 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f850e6-0a3f-48c1-b501-2fe091f7c4a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:39.790053 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f850e6-0a3f-48c1-b501-2fe091f7c4a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:39.790645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f850e6-0a3f-48c1-b501-2fe091f7c4a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:39.792763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f850e6-0a3f-48c1-b501-2fe091f7c4a1 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:39.863135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 841/1685] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:39.863745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 845/1686] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:39.863745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e5a55-5225-4f38-8016-2c15645b74f5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:39.863745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e5a55-5225-4f38-8016-2c15645b74f5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:39.863745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e5a55-5225-4f38-8016-2c15645b74f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:39.864042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f850e6-0a3f-48c1-b501-2fe091f7c4a1 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:39.864042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f850e6-0a3f-48c1-b501-2fe091f7c4a1 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:39.871408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477da516-7c2e-461a-919f-2f2dac214ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:39.874300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477da516-7c2e-461a-919f-2f2dac214ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:39.876674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477da516-7c2e-461a-919f-2f2dac214ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:39.877247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477da516-7c2e-461a-919f-2f2dac214ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:39.878715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477da516-7c2e-461a-919f-2f2dac214ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:39.881728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477da516-7c2e-461a-919f-2f2dac214ee7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:39.896107 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b88e5a55-5225-4f38-8016-2c15645b74f5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:39.897808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b88e5a55-5225-4f38-8016-2c15645b74f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:39.912202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 846/1687] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:39.946407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e5a55-5225-4f38-8016-2c15645b74f5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:39.950511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b88e5a55-5225-4f38-8016-2c15645b74f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:40.092438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e5a55-5225-4f38-8016-2c15645b74f5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:40.092438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b899134-8ee9-4aa7-b5d2-751c78b08a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:40.092438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b899134-8ee9-4aa7-b5d2-751c78b08a2e service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:40.092438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b899134-8ee9-4aa7-b5d2-751c78b08a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:40.093273 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b899134-8ee9-4aa7-b5d2-751c78b08a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:40.107021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b899134-8ee9-4aa7-b5d2-751c78b08a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:40.109853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b899134-8ee9-4aa7-b5d2-751c78b08a2e service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:40.137685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 847/1688] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:40.257244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 842/1689] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:39 2022] POST /identity/v3/projects => generated 399 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:40.261487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b899134-8ee9-4aa7-b5d2-751c78b08a2e service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:40.277168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b899134-8ee9-4aa7-b5d2-751c78b08a2e service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:40.364052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe6f5-062c-48ed-9575-a03cc2679131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:40.365938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe6f5-062c-48ed-9575-a03cc2679131 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:40.366248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe6f5-062c-48ed-9575-a03cc2679131 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:40.366808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe6f5-062c-48ed-9575-a03cc2679131 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:40.367479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbe6f5-062c-48ed-9575-a03cc2679131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:40.369656 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbe6f5-062c-48ed-9575-a03cc2679131 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:40.613798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 848/1690] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:40 2022] POST /identity/v3/users => generated 300 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:57:40.621116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477da516-7c2e-461a-919f-2f2dac214ee7 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:40.647833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477da516-7c2e-461a-919f-2f2dac214ee7 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:40.654366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:40.684232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1456d-3895-4f96-ae0f-53d393212c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:40.684232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1456d-3895-4f96-ae0f-53d393212c18 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:40.684232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1456d-3895-4f96-ae0f-53d393212c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:40.684232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1456d-3895-4f96-ae0f-53d393212c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:40.690915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1456d-3895-4f96-ae0f-53d393212c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:40.690915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1456d-3895-4f96-ae0f-53d393212c18 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:40.727129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 843/1691] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:40.731166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe6f5-062c-48ed-9575-a03cc2679131 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:40.751791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe6f5-062c-48ed-9575-a03cc2679131 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:40.765610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af483e54-cc8e-46c3-8758-6764eb44ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:40.766259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af483e54-cc8e-46c3-8758-6764eb44ebc6 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:40.766543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af483e54-cc8e-46c3-8758-6764eb44ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:40.767002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af483e54-cc8e-46c3-8758-6764eb44ebc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:40.767728 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af483e54-cc8e-46c3-8758-6764eb44ebc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:40.770455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af483e54-cc8e-46c3-8758-6764eb44ebc6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:40.794392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1456d-3895-4f96-ae0f-53d393212c18 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:40.796245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-57e1456d-3895-4f96-ae0f-53d393212c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:40.814273 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 849/1692] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:57:40.824722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af483e54-cc8e-46c3-8758-6764eb44ebc6 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:40.828150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1456d-3895-4f96-ae0f-53d393212c18 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:40.841494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:40.842161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:40.842463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:40.842711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] PATH_INFO: `/v3/projects/f5b8dc0a6d1d430ba677bf1c7dc37b2d` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:40.848816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b8dc0a6d1d430ba677bf1c7dc37b2d)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:40.851140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af483e54-cc8e-46c3-8758-6764eb44ebc6 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:40.853078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:40.866480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac87648-0c98-4e84-9bb8-92c09b1db94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:40.867852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac87648-0c98-4e84-9bb8-92c09b1db94c admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:40.868298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac87648-0c98-4e84-9bb8-92c09b1db94c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:40.868849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac87648-0c98-4e84-9bb8-92c09b1db94c admin admin] PATH_INFO: `/v3/projects/b3e84ec2796240c2b15085d71a024ab4/users/d6550138725d45f3b45101c304b64b83/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:40.902104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac87648-0c98-4e84-9bb8-92c09b1db94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e84ec2796240c2b15085d71a024ab4, user_id=d6550138725d45f3b45101c304b64b83, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:40.909035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac87648-0c98-4e84-9bb8-92c09b1db94c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:41.094332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 850/1693] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:40 2022] PUT /identity/v3/projects/b3e84ec2796240c2b15085d71a024ab4/users/d6550138725d45f3b45101c304b64b83/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:41.111900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b8dc0a6d1d430ba677bf1c7dc37b2d', 'request_id': 'req-a6c997c5-557c-460d-98fc-2679c76ed7dd'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:41.119840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc310-6eb2-44ec-8660-a6b165514c38 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:41.123170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc310-6eb2-44ec-8660-a6b165514c38 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:41.123462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc310-6eb2-44ec-8660-a6b165514c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:41.269998 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b8dc0a6d1d430ba677bf1c7dc37b2d', 'request_id': 'req-a6c997c5-557c-460d-98fc-2679c76ed7dd'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:41.285006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b8dc0a6d1d430ba677bf1c7dc37b2d', 'request_id': 'req-a6c997c5-557c-460d-98fc-2679c76ed7dd'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:41.322038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] The token cache is being invalidate because project f5b8dc0a6d1d430ba677bf1c7dc37b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:57:41.322608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:41.324404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a6c997c5-557c-460d-98fc-2679c76ed7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:41.328371 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 844/1694] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:57:40 2022] DELETE /identity/v3/projects/f5b8dc0a6d1d430ba677bf1c7dc37b2d => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:57:41.336790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e1724-30a4-4bc2-ac81-ae44ddc95d0e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:41.337630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-9e3bc310-6eb2-44ec-8660-a6b165514c38 None None] MFA Rules not processed for user `d6550138725d45f3b45101c304b64b83`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:41.339402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e1724-30a4-4bc2-ac81-ae44ddc95d0e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:41.340221 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e1724-30a4-4bc2-ac81-ae44ddc95d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:41.351739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9e3bc310-6eb2-44ec-8660-a6b165514c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:41.383157 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-376e1724-30a4-4bc2-ac81-ae44ddc95d0e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:41.387689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-376e1724-30a4-4bc2-ac81-ae44ddc95d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:41.591547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 851/1695] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:41.592752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bc310-6eb2-44ec-8660-a6b165514c38 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:41.595100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9e3bc310-6eb2-44ec-8660-a6b165514c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:41.651066 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 845/1696] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:41.652704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e1724-30a4-4bc2-ac81-ae44ddc95d0e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:41.655367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-376e1724-30a4-4bc2-ac81-ae44ddc95d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:41.684636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e1724-30a4-4bc2-ac81-ae44ddc95d0e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:41.696577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353a4d5-b9b4-46b8-9c7e-86585c8212f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:41.697870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353a4d5-b9b4-46b8-9c7e-86585c8212f2 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:41.698422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353a4d5-b9b4-46b8-9c7e-86585c8212f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:41.698914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353a4d5-b9b4-46b8-9c7e-86585c8212f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:41.700461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353a4d5-b9b4-46b8-9c7e-86585c8212f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:41.705178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353a4d5-b9b4-46b8-9c7e-86585c8212f2 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:41.711411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bc310-6eb2-44ec-8660-a6b165514c38 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:41.717384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:41.717384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:41.717384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:41.717384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] PATH_INFO: `/v3/projects/4f5c9d3264e74b68946e87e7eb19ac7c` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:41.719250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5c9d3264e74b68946e87e7eb19ac7c)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:41.721289 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:41.904060 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 846/1697] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:41 2022] POST /identity/v3/projects => generated 401 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:41.905851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3247a-e58f-4b01-8ca7-340eb0a1d544 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:41.906402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3247a-e58f-4b01-8ca7-340eb0a1d544 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:41.907009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3247a-e58f-4b01-8ca7-340eb0a1d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:41.976823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-eaa3247a-e58f-4b01-8ca7-340eb0a1d544 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:41.984778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-eaa3247a-e58f-4b01-8ca7-340eb0a1d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:42.022878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5c9d3264e74b68946e87e7eb19ac7c', 'request_id': 'req-5651000b-ac70-45b5-875c-dd5aa877c531'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:42.035175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5c9d3264e74b68946e87e7eb19ac7c', 'request_id': 'req-5651000b-ac70-45b5-875c-dd5aa877c531'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:42.075794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5c9d3264e74b68946e87e7eb19ac7c', 'request_id': 'req-5651000b-ac70-45b5-875c-dd5aa877c531'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:42.235061 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] The token cache is being invalidate because project 4f5c9d3264e74b68946e87e7eb19ac7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:57:42.235559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:42.238286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:42.243552 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 852/1698] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:57:41 2022] DELETE /identity/v3/projects/4f5c9d3264e74b68946e87e7eb19ac7c => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:42.260985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:42.266602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:42.317287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 847/1699] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:42.317287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3247a-e58f-4b01-8ca7-340eb0a1d544 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:42.330906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-eaa3247a-e58f-4b01-8ca7-340eb0a1d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:42.406457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3247a-e58f-4b01-8ca7-340eb0a1d544 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:42.424707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:42.425619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:42.426005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:42.426374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] PATH_INFO: `/v3/users/5e6f1a22b112401eb0c03a964ee4f7db` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:42.430399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6f1a22b112401eb0c03a964ee4f7db)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:42.432580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:42.521802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651000b-ac70-45b5-875c-dd5aa877c531 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:42.537594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278cae4-a23b-445c-b8f5-9a2d87744123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:42.538256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278cae4-a23b-445c-b8f5-9a2d87744123 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:42.538598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278cae4-a23b-445c-b8f5-9a2d87744123 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:42.538874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278cae4-a23b-445c-b8f5-9a2d87744123 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:42.539650 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278cae4-a23b-445c-b8f5-9a2d87744123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:42.545830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278cae4-a23b-445c-b8f5-9a2d87744123 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:42.888662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 853/1700] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:42 2022] POST /identity/v3/users => generated 307 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:42.891223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278cae4-a23b-445c-b8f5-9a2d87744123 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:42.947670 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278cae4-a23b-445c-b8f5-9a2d87744123 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:42.959655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6f1a22b112401eb0c03a964ee4f7db'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:42.970279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c940d-5d1f-41dd-ba46-678ccf1b1205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:42.972968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c940d-5d1f-41dd-ba46-678ccf1b1205 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:42.973486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c940d-5d1f-41dd-ba46-678ccf1b1205 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:42.973949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c940d-5d1f-41dd-ba46-678ccf1b1205 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:42.975636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c940d-5d1f-41dd-ba46-678ccf1b1205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:42.981660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c940d-5d1f-41dd-ba46-678ccf1b1205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:43.007445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c940d-5d1f-41dd-ba46-678ccf1b1205 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:43.038186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6f1a22b112401eb0c03a964ee4f7db'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:43.092754 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 854/1701] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:43.092754 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c940d-5d1f-41dd-ba46-678ccf1b1205 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:43.128302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c940d-5d1f-41dd-ba46-678ccf1b1205 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:43.136195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504ed34-49e1-4749-84a4-38ab96980cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:43.138357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ed34-49e1-4749-84a4-38ab96980cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:43.138775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ed34-49e1-4749-84a4-38ab96980cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:43.139343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504ed34-49e1-4749-84a4-38ab96980cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:43.140397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504ed34-49e1-4749-84a4-38ab96980cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:43.154275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504ed34-49e1-4749-84a4-38ab96980cc0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:43.180783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 855/1702] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:43.181525 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504ed34-49e1-4749-84a4-38ab96980cc0 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:43.194838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504ed34-49e1-4749-84a4-38ab96980cc0 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:43.200783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6f1a22b112401eb0c03a964ee4f7db'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:43.202069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6f1a22b112401eb0c03a964ee4f7db'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:43.210217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e9e3a-30db-4d69-86f8-7bb3f0e4f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:43.211232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e9e3a-30db-4d69-86f8-7bb3f0e4f090 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:43.211506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e9e3a-30db-4d69-86f8-7bb3f0e4f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:43.211969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e9e3a-30db-4d69-86f8-7bb3f0e4f090 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:43.212818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e9e3a-30db-4d69-86f8-7bb3f0e4f090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:43.214777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e9e3a-30db-4d69-86f8-7bb3f0e4f090 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:43.225785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6f1a22b112401eb0c03a964ee4f7db'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:43.238812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 848/1703] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:57:42 2022] DELETE /identity/v3/users/5e6f1a22b112401eb0c03a964ee4f7db => generated 0 bytes in 924 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:43.240333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:43.242635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:43.328161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961cb7d-c820-4c89-9b75-c0653e781fe6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:43.340289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdc186-5484-4eb0-9dcf-c52802d45a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:43.341277 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdc186-5484-4eb0-9dcf-c52802d45a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:43.341853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdc186-5484-4eb0-9dcf-c52802d45a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:43.342303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdc186-5484-4eb0-9dcf-c52802d45a77 admin admin] PATH_INFO: `/v3/projects/56b009acad1b43ae8f4edca0082f6c41/users/62b8bf0da05d4d01be3f4137ae39b7b0/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:43.367933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdc186-5484-4eb0-9dcf-c52802d45a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b009acad1b43ae8f4edca0082f6c41, user_id=62b8bf0da05d4d01be3f4137ae39b7b0, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:43.374521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdc186-5484-4eb0-9dcf-c52802d45a77 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:43.384372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 856/1704] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:43 2022] POST /identity/v3/projects => generated 357 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:43.386044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e9e3a-30db-4d69-86f8-7bb3f0e4f090 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:43.394285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6e4e9e3a-30db-4d69-86f8-7bb3f0e4f090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:43.480372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e9e3a-30db-4d69-86f8-7bb3f0e4f090 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:43.485142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323f924-8f30-42d9-b907-40630447d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:43.485758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323f924-8f30-42d9-b907-40630447d02b admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:43.486209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323f924-8f30-42d9-b907-40630447d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:43.486799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323f924-8f30-42d9-b907-40630447d02b admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:43.487092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323f924-8f30-42d9-b907-40630447d02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:43.489087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323f924-8f30-42d9-b907-40630447d02b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:43.548310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 849/1705] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:43 2022] PUT /identity/v3/projects/56b009acad1b43ae8f4edca0082f6c41/users/62b8bf0da05d4d01be3f4137ae39b7b0/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:43.549480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdc186-5484-4eb0-9dcf-c52802d45a77 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:43.662739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdc186-5484-4eb0-9dcf-c52802d45a77 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:43.668702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad277a-174c-4248-b000-5fb668072415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:43.669608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad277a-174c-4248-b000-5fb668072415 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:43.669887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad277a-174c-4248-b000-5fb668072415 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:43.670158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad277a-174c-4248-b000-5fb668072415 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:43.670875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad277a-174c-4248-b000-5fb668072415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:43.673240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad277a-174c-4248-b000-5fb668072415 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:43.689128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 850/1706] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:57:43.693999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad277a-174c-4248-b000-5fb668072415 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:43.710291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad277a-174c-4248-b000-5fb668072415 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:43.710514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 857/1707] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:43 2022] POST /identity/v3/users => generated 279 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:43.718670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1ad36-acf8-4177-8cc0-0f37367ab891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:43.718670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ad36-acf8-4177-8cc0-0f37367ab891 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:43.718670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ad36-acf8-4177-8cc0-0f37367ab891 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:43.719275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1ad36-acf8-4177-8cc0-0f37367ab891 admin admin] PATH_INFO: `/v3/projects/56b009acad1b43ae8f4edca0082f6c41/users/62b8bf0da05d4d01be3f4137ae39b7b0/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:43.719760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323f924-8f30-42d9-b907-40630447d02b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:43.721904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1ad36-acf8-4177-8cc0-0f37367ab891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b009acad1b43ae8f4edca0082f6c41, user_id=62b8bf0da05d4d01be3f4137ae39b7b0, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:43.725072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1ad36-acf8-4177-8cc0-0f37367ab891 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:43.731335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323f924-8f30-42d9-b907-40630447d02b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:43.768453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 851/1708] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:43 2022] PUT /identity/v3/projects/56b009acad1b43ae8f4edca0082f6c41/users/62b8bf0da05d4d01be3f4137ae39b7b0/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:57:43.778540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b8947-04a0-4ef3-bba8-6580e449bac5 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:43.778860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b8947-04a0-4ef3-bba8-6580e449bac5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:43.779180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b8947-04a0-4ef3-bba8-6580e449bac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:43.837707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-300b8947-04a0-4ef3-bba8-6580e449bac5 None None] MFA Rules not processed for user `62b8bf0da05d4d01be3f4137ae39b7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:43.839423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-300b8947-04a0-4ef3-bba8-6580e449bac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:43.840238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e984d-5244-41b1-8e48-8aebf421f268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:43.842039 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e984d-5244-41b1-8e48-8aebf421f268 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:43.842615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e984d-5244-41b1-8e48-8aebf421f268 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:43.842615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e984d-5244-41b1-8e48-8aebf421f268 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:43.843727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e984d-5244-41b1-8e48-8aebf421f268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:43.845510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e984d-5244-41b1-8e48-8aebf421f268 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:43.859886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 858/1709] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:57:43.861629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e984d-5244-41b1-8e48-8aebf421f268 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:43.874170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e984d-5244-41b1-8e48-8aebf421f268 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:43.880131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf492ed-e8da-4dda-bd9e-800088e0d31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:43.881156 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf492ed-e8da-4dda-bd9e-800088e0d31e admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:43.881532 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf492ed-e8da-4dda-bd9e-800088e0d31e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:43.882844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf492ed-e8da-4dda-bd9e-800088e0d31e admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:43.883329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf492ed-e8da-4dda-bd9e-800088e0d31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:43.885094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf492ed-e8da-4dda-bd9e-800088e0d31e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:43.905611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 859/1710] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:43.922549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf492ed-e8da-4dda-bd9e-800088e0d31e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:43.941580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf492ed-e8da-4dda-bd9e-800088e0d31e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:43.948734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664f358-7f67-40ab-a672-1bf10f53cbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:43.949738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664f358-7f67-40ab-a672-1bf10f53cbce admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:43.950237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664f358-7f67-40ab-a672-1bf10f53cbce admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:43.950701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664f358-7f67-40ab-a672-1bf10f53cbce admin admin] PATH_INFO: `/v3/projects/690134afbe59416e9337245e37d660b4/users/9c9d4f755b2a40c98c00cc5c79063cc4/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:43.952937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 852/1711] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:43 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:43.965190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b8947-04a0-4ef3-bba8-6580e449bac5 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:43.973052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-300b8947-04a0-4ef3-bba8-6580e449bac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:43.994953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664f358-7f67-40ab-a672-1bf10f53cbce admin admin] RBAC: Authorizing `identity:create_grant(project_id=690134afbe59416e9337245e37d660b4, user_id=9c9d4f755b2a40c98c00cc5c79063cc4, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:44.007550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664f358-7f67-40ab-a672-1bf10f53cbce admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:44.056179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b8947-04a0-4ef3-bba8-6580e449bac5 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:44.060891 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad818b-8b75-4a0c-a146-f3a0655926f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:44.061853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad818b-8b75-4a0c-a146-f3a0655926f2 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:44.062136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad818b-8b75-4a0c-a146-f3a0655926f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:44.062419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad818b-8b75-4a0c-a146-f3a0655926f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:44.071729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad818b-8b75-4a0c-a146-f3a0655926f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:44.073186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad818b-8b75-4a0c-a146-f3a0655926f2 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:44.083320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 853/1712] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:43 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:57:44.181443 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 860/1713] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:43 2022] PUT /identity/v3/projects/690134afbe59416e9337245e37d660b4/users/9c9d4f755b2a40c98c00cc5c79063cc4/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:44.190037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad818b-8b75-4a0c-a146-f3a0655926f2 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:44.192077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c6ad818b-8b75-4a0c-a146-f3a0655926f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:44.202275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515862ac-e826-402f-9182-08d21fbd168f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:44.202564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515862ac-e826-402f-9182-08d21fbd168f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:44.202846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515862ac-e826-402f-9182-08d21fbd168f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:44.225721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad818b-8b75-4a0c-a146-f3a0655926f2 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:44.263670 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-515862ac-e826-402f-9182-08d21fbd168f None None] MFA Rules not processed for user `9c9d4f755b2a40c98c00cc5c79063cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:44.265132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-515862ac-e826-402f-9182-08d21fbd168f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:44.343314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:44.344203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:44.344390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:44.344822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] PATH_INFO: `/v3/projects/129ca08207c94a9ca81f54cc61228c8e` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:44.345944 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=129ca08207c94a9ca81f54cc61228c8e)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:44.348611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:44.360459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 861/1714] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:44.366387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515862ac-e826-402f-9182-08d21fbd168f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:44.389851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515862ac-e826-402f-9182-08d21fbd168f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:44.395338 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2068d-e5a2-44b4-b15c-58d33e545139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:44.396626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2068d-e5a2-44b4-b15c-58d33e545139 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:44.397009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2068d-e5a2-44b4-b15c-58d33e545139 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:44.397375 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2068d-e5a2-44b4-b15c-58d33e545139 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:44.398110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2068d-e5a2-44b4-b15c-58d33e545139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:44.400249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2068d-e5a2-44b4-b15c-58d33e545139 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:44.661645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 862/1715] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:44 2022] POST /identity/v3/projects => generated 355 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:57:44.665738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2068d-e5a2-44b4-b15c-58d33e545139 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:44.697979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129ca08207c94a9ca81f54cc61228c8e', 'request_id': 'req-d9503947-2a90-458e-af61-d517b50f14b3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:44.766696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2068d-e5a2-44b4-b15c-58d33e545139 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:44.772317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e6f30-3f14-4cd7-97ce-f4dfb3bcfa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:44.772971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e6f30-3f14-4cd7-97ce-f4dfb3bcfa11 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:44.773255 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e6f30-3f14-4cd7-97ce-f4dfb3bcfa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:44.773562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e6f30-3f14-4cd7-97ce-f4dfb3bcfa11 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:44.774218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e6f30-3f14-4cd7-97ce-f4dfb3bcfa11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:44.776152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e6f30-3f14-4cd7-97ce-f4dfb3bcfa11 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.039425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129ca08207c94a9ca81f54cc61228c8e', 'request_id': 'req-d9503947-2a90-458e-af61-d517b50f14b3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:45.048239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129ca08207c94a9ca81f54cc61228c8e', 'request_id': 'req-d9503947-2a90-458e-af61-d517b50f14b3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:45.062384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] The token cache is being invalidate because project 129ca08207c94a9ca81f54cc61228c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:57:45.062682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:45.063389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:45.065345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 854/1716] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:57:44 2022] DELETE /identity/v3/projects/129ca08207c94a9ca81f54cc61228c8e => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:45.066283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.067686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:45.091052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 863/1717] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:44 2022] POST /identity/v3/users => generated 284 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:45.091541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1e65-d451-438f-82d4-fce3c0c3a580 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.091541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1e65-d451-438f-82d4-fce3c0c3a580 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.091716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1e65-d451-438f-82d4-fce3c0c3a580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.128855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-352c1e65-d451-438f-82d4-fce3c0c3a580 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:45.130145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-352c1e65-d451-438f-82d4-fce3c0c3a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:45.140172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 864/1718] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:45.141164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c1e65-d451-438f-82d4-fce3c0c3a580 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.147834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-352c1e65-d451-438f-82d4-fce3c0c3a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:45.163096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9503947-2a90-458e-af61-d517b50f14b3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.163414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c1e65-d451-438f-82d4-fce3c0c3a580 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.168779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b307eb-dd94-4339-9d25-2282ff156017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.169568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b307eb-dd94-4339-9d25-2282ff156017 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.169837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b307eb-dd94-4339-9d25-2282ff156017 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.170194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b307eb-dd94-4339-9d25-2282ff156017 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.170834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b307eb-dd94-4339-9d25-2282ff156017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.172582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b307eb-dd94-4339-9d25-2282ff156017 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.187504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 865/1719] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:45.187504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e054102-3732-45aa-82ca-cc86ce1f80a8 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.187504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e054102-3732-45aa-82ca-cc86ce1f80a8 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.197016 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e054102-3732-45aa-82ca-cc86ce1f80a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.218397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4e054102-3732-45aa-82ca-cc86ce1f80a8 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:45.219588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4e054102-3732-45aa-82ca-cc86ce1f80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:45.219853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0c364-215b-4f11-83d8-cab19eb0415c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.220565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c364-215b-4f11-83d8-cab19eb0415c service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.220914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c364-215b-4f11-83d8-cab19eb0415c service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.221279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0c364-215b-4f11-83d8-cab19eb0415c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.223027 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d7a0c364-215b-4f11-83d8-cab19eb0415c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:45.228346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 866/1720] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:45.229217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e054102-3732-45aa-82ca-cc86ce1f80a8 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.242731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e054102-3732-45aa-82ca-cc86ce1f80a8 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.247675 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7f64d-ec44-4f95-bcb4-f6763624e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.248336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7f64d-ec44-4f95-bcb4-f6763624e33a admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.248639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7f64d-ec44-4f95-bcb4-f6763624e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.248908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7f64d-ec44-4f95-bcb4-f6763624e33a admin admin] PATH_INFO: `/v3/projects/0f554efce1bf46b898be56a4fe0b087b/users/e3c7bad9b31d426499842dbbb2873fab/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.265155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7f64d-ec44-4f95-bcb4-f6763624e33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f554efce1bf46b898be56a4fe0b087b, user_id=e3c7bad9b31d426499842dbbb2873fab, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.267945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7f64d-ec44-4f95-bcb4-f6763624e33a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.290623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0c364-215b-4f11-83d8-cab19eb0415c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.292075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0c364-215b-4f11-83d8-cab19eb0415c service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.301552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 855/1721] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:45.302743 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0c364-215b-4f11-83d8-cab19eb0415c service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.314305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0c364-215b-4f11-83d8-cab19eb0415c service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.322337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4f33a-fb4c-4395-92db-d74dbfb532eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.322970 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4f33a-fb4c-4395-92db-d74dbfb532eb admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.323339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4f33a-fb4c-4395-92db-d74dbfb532eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.323556 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4f33a-fb4c-4395-92db-d74dbfb532eb admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.324180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4f33a-fb4c-4395-92db-d74dbfb532eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:57:45.324615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4f33a-fb4c-4395-92db-d74dbfb532eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.326176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4f33a-fb4c-4395-92db-d74dbfb532eb admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.343115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 856/1722] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:57:45.347642 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4f33a-fb4c-4395-92db-d74dbfb532eb admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.358813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4f33a-fb4c-4395-92db-d74dbfb532eb admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.364157 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fcdf6-b418-4cc7-b919-d5274565b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.364964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fcdf6-b418-4cc7-b919-d5274565b01b admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.365146 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fcdf6-b418-4cc7-b919-d5274565b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.365476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fcdf6-b418-4cc7-b919-d5274565b01b admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.366041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fcdf6-b418-4cc7-b919-d5274565b01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.368014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fcdf6-b418-4cc7-b919-d5274565b01b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.383783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 867/1723] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:45 2022] PUT /identity/v3/projects/0f554efce1bf46b898be56a4fe0b087b/users/e3c7bad9b31d426499842dbbb2873fab/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:45.389259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7f64d-ec44-4f95-bcb4-f6763624e33a admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.457937 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7f64d-ec44-4f95-bcb4-f6763624e33a admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.463307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd266d8-9ef3-4de5-a420-199caa1bb6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.463949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd266d8-9ef3-4de5-a420-199caa1bb6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.464229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd266d8-9ef3-4de5-a420-199caa1bb6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.464497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd266d8-9ef3-4de5-a420-199caa1bb6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.465157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd266d8-9ef3-4de5-a420-199caa1bb6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.466757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd266d8-9ef3-4de5-a420-199caa1bb6a4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.476606 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 868/1724] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:45.481070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd266d8-9ef3-4de5-a420-199caa1bb6a4 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.492273 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd266d8-9ef3-4de5-a420-199caa1bb6a4 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.495068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 857/1725] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:45 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:57:45.498848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fcdf6-b418-4cc7-b919-d5274565b01b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.500427 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ad137-0454-467c-91e9-e3596bc0aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.501236 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ad137-0454-467c-91e9-e3596bc0aa1b admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.501556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ad137-0454-467c-91e9-e3596bc0aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.501837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ad137-0454-467c-91e9-e3596bc0aa1b admin admin] PATH_INFO: `/v3/projects/0f554efce1bf46b898be56a4fe0b087b/users/e3c7bad9b31d426499842dbbb2873fab/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.503749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ad137-0454-467c-91e9-e3596bc0aa1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f554efce1bf46b898be56a4fe0b087b, user_id=e3c7bad9b31d426499842dbbb2873fab, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.507036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ad137-0454-467c-91e9-e3596bc0aa1b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.520323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 869/1726] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:45 2022] PUT /identity/v3/projects/0f554efce1bf46b898be56a4fe0b087b/users/e3c7bad9b31d426499842dbbb2873fab/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:57:45.533117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43093da3-0a76-4771-a198-5b97b5116034 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.533435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43093da3-0a76-4771-a198-5b97b5116034 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.533710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43093da3-0a76-4771-a198-5b97b5116034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.564853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-43093da3-0a76-4771-a198-5b97b5116034 None None] MFA Rules not processed for user `e3c7bad9b31d426499842dbbb2873fab`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:45.566099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-43093da3-0a76-4771-a198-5b97b5116034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:45.580638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fcdf6-b418-4cc7-b919-d5274565b01b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.639566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7024d-aea0-4cb4-9854-c980c382c7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.640238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7024d-aea0-4cb4-9854-c980c382c7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.640537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7024d-aea0-4cb4-9854-c980c382c7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.640821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7024d-aea0-4cb4-9854-c980c382c7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.641290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 870/1727] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:57:45.641491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7024d-aea0-4cb4-9854-c980c382c7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.643501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7024d-aea0-4cb4-9854-c980c382c7b5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.654666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43093da3-0a76-4771-a198-5b97b5116034 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.656092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-43093da3-0a76-4771-a198-5b97b5116034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:45.714786 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43093da3-0a76-4771-a198-5b97b5116034 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.719120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44259399-7f15-4f13-9a6d-1152c7468ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.719847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44259399-7f15-4f13-9a6d-1152c7468ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.720082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44259399-7f15-4f13-9a6d-1152c7468ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.720358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44259399-7f15-4f13-9a6d-1152c7468ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.742939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44259399-7f15-4f13-9a6d-1152c7468ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.744609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44259399-7f15-4f13-9a6d-1152c7468ec0 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.768896 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 871/1728] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:57:45.795270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:45.804120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 858/1729] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:45 2022] POST /identity/v3/users => generated 283 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:57:45.811972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44259399-7f15-4f13-9a6d-1152c7468ec0 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.820447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44259399-7f15-4f13-9a6d-1152c7468ec0 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.828366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042de74-c72f-461d-b2ff-36ca3f6b2925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.829020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042de74-c72f-461d-b2ff-36ca3f6b2925 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.829340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042de74-c72f-461d-b2ff-36ca3f6b2925 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.829572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042de74-c72f-461d-b2ff-36ca3f6b2925 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.830218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042de74-c72f-461d-b2ff-36ca3f6b2925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.831850 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042de74-c72f-461d-b2ff-36ca3f6b2925 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.847421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 872/1730] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:57:45.855398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7024d-aea0-4cb4-9854-c980c382c7b5 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.868684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7024d-aea0-4cb4-9854-c980c382c7b5 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.876355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf38724-bd65-430a-91d5-ee088530ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.877019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf38724-bd65-430a-91d5-ee088530ffb9 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.877304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf38724-bd65-430a-91d5-ee088530ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.888116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf38724-bd65-430a-91d5-ee088530ffb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.888935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf38724-bd65-430a-91d5-ee088530ffb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.890712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf38724-bd65-430a-91d5-ee088530ffb9 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:45.916611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 859/1731] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:57:45.920713 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042de74-c72f-461d-b2ff-36ca3f6b2925 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:45.937200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042de74-c72f-461d-b2ff-36ca3f6b2925 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:45.944545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0ba12-1a2b-4120-8cbf-166dacb01949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:45.944855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0ba12-1a2b-4120-8cbf-166dacb01949 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:45.945171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0ba12-1a2b-4120-8cbf-166dacb01949 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:45.954113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0ba12-1a2b-4120-8cbf-166dacb01949 admin admin] PATH_INFO: `/v3/projects/d8cd6e1b75894bd9bcff58bb7505fdb6/users/c1448341b0cd4e6a8a00c6e6c42a6e6c/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:45.976952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0ba12-1a2b-4120-8cbf-166dacb01949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cd6e1b75894bd9bcff58bb7505fdb6, user_id=c1448341b0cd4e6a8a00c6e6c42a6e6c, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:45.981185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0ba12-1a2b-4120-8cbf-166dacb01949 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:46.192374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 873/1732] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:45 2022] PUT /identity/v3/projects/d8cd6e1b75894bd9bcff58bb7505fdb6/users/c1448341b0cd4e6a8a00c6e6c42a6e6c/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:46.200097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf65f-2de8-4e88-9b50-7b210712073e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:46.201910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf65f-2de8-4e88-9b50-7b210712073e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:46.202358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf65f-2de8-4e88-9b50-7b210712073e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:46.290926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0ba12-1a2b-4120-8cbf-166dacb01949 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:46.330856 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-016bf65f-2de8-4e88-9b50-7b210712073e None None] MFA Rules not processed for user `c1448341b0cd4e6a8a00c6e6c42a6e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:46.336314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-016bf65f-2de8-4e88-9b50-7b210712073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:46.406854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:46.436854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0ba12-1a2b-4120-8cbf-166dacb01949 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:46.442290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46951cea-10f7-44be-9680-1798c84466d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:46.442431 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46951cea-10f7-44be-9680-1798c84466d1 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:46.442662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46951cea-10f7-44be-9680-1798c84466d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:46.442966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46951cea-10f7-44be-9680-1798c84466d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:46.461747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-46951cea-10f7-44be-9680-1798c84466d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:46.529684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 860/1733] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:46.533300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bf65f-2de8-4e88-9b50-7b210712073e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:46.649070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46951cea-10f7-44be-9680-1798c84466d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:46.651862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46951cea-10f7-44be-9680-1798c84466d1 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:46.663844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 874/1734] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:57:46.688039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bf65f-2de8-4e88-9b50-7b210712073e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:46.695579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506812-4733-4f3b-b7bc-69a3a2c79bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:46.696240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506812-4733-4f3b-b7bc-69a3a2c79bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:46.696541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506812-4733-4f3b-b7bc-69a3a2c79bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:46.696823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506812-4733-4f3b-b7bc-69a3a2c79bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:46.697567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10506812-4733-4f3b-b7bc-69a3a2c79bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:46.699792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10506812-4733-4f3b-b7bc-69a3a2c79bd9 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:47.037336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803324-575b-49de-98de-851c8d6fcf53 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:47.037959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803324-575b-49de-98de-851c8d6fcf53 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:47.038707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803324-575b-49de-98de-851c8d6fcf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:47.049338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 861/1735] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:57:46 2022] POST /identity/v3/projects => generated 365 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:57:47.058039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506812-4733-4f3b-b7bc-69a3a2c79bd9 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:47.105341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-9a803324-575b-49de-98de-851c8d6fcf53 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:47.106753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9a803324-575b-49de-98de-851c8d6fcf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:47.200936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 875/1736] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 15:57:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:57:47.228309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506812-4733-4f3b-b7bc-69a3a2c79bd9 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:47.241199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ccd95-06c8-4f19-a93b-5b1b2f61324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:47.242111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ccd95-06c8-4f19-a93b-5b1b2f61324c admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:47.242306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ccd95-06c8-4f19-a93b-5b1b2f61324c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:47.242588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ccd95-06c8-4f19-a93b-5b1b2f61324c admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:47.243469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ccd95-06c8-4f19-a93b-5b1b2f61324c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:47.246369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ccd95-06c8-4f19-a93b-5b1b2f61324c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:47.487313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 862/1737] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:57:47 2022] POST /identity/v3/users => generated 289 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:57:47.491943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803324-575b-49de-98de-851c8d6fcf53 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:47.538942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803324-575b-49de-98de-851c8d6fcf53 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:47.553923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f454fa6-4b65-497a-a052-8d32f933e053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:47.564492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454fa6-4b65-497a-a052-8d32f933e053 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:47.564492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454fa6-4b65-497a-a052-8d32f933e053 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:47.564492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f454fa6-4b65-497a-a052-8d32f933e053 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:47.564492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f454fa6-4b65-497a-a052-8d32f933e053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:47.564492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f454fa6-4b65-497a-a052-8d32f933e053 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:47.580817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ccd95-06c8-4f19-a93b-5b1b2f61324c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:47.581281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 876/1738] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:47.594652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ccd95-06c8-4f19-a93b-5b1b2f61324c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:47.601727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd6bde-3a64-4ea3-a327-e9da32d97e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:47.602565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6bde-3a64-4ea3-a327-e9da32d97e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:47.602950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6bde-3a64-4ea3-a327-e9da32d97e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:47.603349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6bde-3a64-4ea3-a327-e9da32d97e47 admin admin] PATH_INFO: `/v3/projects/a034da0dfcd34f39af49f5e60bc32837/users/11e685cff40d43c0bc682d367dbe0c3e/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:47.630031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd6bde-3a64-4ea3-a327-e9da32d97e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a034da0dfcd34f39af49f5e60bc32837, user_id=11e685cff40d43c0bc682d367dbe0c3e, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:47.633535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd6bde-3a64-4ea3-a327-e9da32d97e47 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:47.702169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f454fa6-4b65-497a-a052-8d32f933e053 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:47.704087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5f454fa6-4b65-497a-a052-8d32f933e053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:47.799877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 863/1739] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:47 2022] PUT /identity/v3/projects/a034da0dfcd34f39af49f5e60bc32837/users/11e685cff40d43c0bc682d367dbe0c3e/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:57:47.805841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd6bde-3a64-4ea3-a327-e9da32d97e47 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:47.994437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd6bde-3a64-4ea3-a327-e9da32d97e47 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:47.998959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ee135-1ef3-4e0d-b9ca-989bdc16e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:47.999741 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ee135-1ef3-4e0d-b9ca-989bdc16e6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:48.000155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ee135-1ef3-4e0d-b9ca-989bdc16e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:48.000480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ee135-1ef3-4e0d-b9ca-989bdc16e6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:48.003589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ee135-1ef3-4e0d-b9ca-989bdc16e6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:48.003700 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f454fa6-4b65-497a-a052-8d32f933e053 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:48.003793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ee135-1ef3-4e0d-b9ca-989bdc16e6a9 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:48.027721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 864/1740] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:48.049771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ee135-1ef3-4e0d-b9ca-989bdc16e6a9 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:48.097845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ee135-1ef3-4e0d-b9ca-989bdc16e6a9 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:48.125749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c1ff3-62c7-4320-b770-b38be146f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:48.127107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c1ff3-62c7-4320-b770-b38be146f556 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:48.129524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c1ff3-62c7-4320-b770-b38be146f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:48.132084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c1ff3-62c7-4320-b770-b38be146f556 admin admin] PATH_INFO: `/v3/projects/a034da0dfcd34f39af49f5e60bc32837/users/11e685cff40d43c0bc682d367dbe0c3e/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:48.137275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee528b2-0e95-43bb-9fd9-8d9f7d240df3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:48.140815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c1ff3-62c7-4320-b770-b38be146f556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a034da0dfcd34f39af49f5e60bc32837, user_id=11e685cff40d43c0bc682d367dbe0c3e, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:48.142365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee528b2-0e95-43bb-9fd9-8d9f7d240df3 service swift] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:48.142884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee528b2-0e95-43bb-9fd9-8d9f7d240df3 service swift] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:48.143362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee528b2-0e95-43bb-9fd9-8d9f7d240df3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:48.154263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c1ff3-62c7-4320-b770-b38be146f556 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:48.188613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 865/1741] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:57:48 2022] PUT /identity/v3/projects/a034da0dfcd34f39af49f5e60bc32837/users/11e685cff40d43c0bc682d367dbe0c3e/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:57:48.199750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12351-bfac-423a-bb75-306c330705b8 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:48.200347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12351-bfac-423a-bb75-306c330705b8 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:48.200864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12351-bfac-423a-bb75-306c330705b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:48.283227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-89f12351-bfac-423a-bb75-306c330705b8 None None] MFA Rules not processed for user `11e685cff40d43c0bc682d367dbe0c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:48.287874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-89f12351-bfac-423a-bb75-306c330705b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:48.337748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:48.351173 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee528b2-0e95-43bb-9fd9-8d9f7d240df3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:48.353165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee528b2-0e95-43bb-9fd9-8d9f7d240df3 service swift] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:48.383861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 877/1742] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 15:57:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 15:57:48.547752 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 866/1743] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:57:48.556649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee528b2-0e95-43bb-9fd9-8d9f7d240df3 service swift] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:48.563470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662544-9b55-4ffa-9765-8fcfe19575f9 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:48.563797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662544-9b55-4ffa-9765-8fcfe19575f9 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:48.564359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36662544-9b55-4ffa-9765-8fcfe19575f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:48.602723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-36662544-9b55-4ffa-9765-8fcfe19575f9 None None] MFA Rules not processed for user `90324fa56d0743699f2fddd17fb630dd`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:48.602916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-36662544-9b55-4ffa-9765-8fcfe19575f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:48.704295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 867/1744] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Aug 22 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:48.704478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee528b2-0e95-43bb-9fd9-8d9f7d240df3 service swift] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:48.797222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36662544-9b55-4ffa-9765-8fcfe19575f9 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:48.799124 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-36662544-9b55-4ffa-9765-8fcfe19575f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:48.818931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36662544-9b55-4ffa-9765-8fcfe19575f9 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:48.834527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0034bda-3158-465d-951d-affb9f6c866b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:48.838413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0034bda-3158-465d-951d-affb9f6c866b service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:48.840460 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0034bda-3158-465d-951d-affb9f6c866b service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:48.841219 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e558f-b024-4523-8bb4-6f689746f2bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:48.842009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e558f-b024-4523-8bb4-6f689746f2bc service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:48.842290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e558f-b024-4523-8bb4-6f689746f2bc service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:48.842562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e558f-b024-4523-8bb4-6f689746f2bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:48.842749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0034bda-3158-465d-951d-affb9f6c866b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:48.869387 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0034bda-3158-465d-951d-affb9f6c866b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:48.870103 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0034bda-3158-465d-951d-affb9f6c866b service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:48.870864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e558f-b024-4523-8bb4-6f689746f2bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:48.872833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e558f-b024-4523-8bb4-6f689746f2bc service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:48.885363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 868/1745] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:57:48.886697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0034bda-3158-465d-951d-affb9f6c866b service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:48.891629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d0034bda-3158-465d-951d-affb9f6c866b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:48.900394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 878/1746] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:48.934027 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0034bda-3158-465d-951d-affb9f6c866b service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:48.950770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94b495-26bb-47ff-a8aa-8eaa347d5aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:48.952956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94b495-26bb-47ff-a8aa-8eaa347d5aea service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:48.953869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94b495-26bb-47ff-a8aa-8eaa347d5aea service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:48.954159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94b495-26bb-47ff-a8aa-8eaa347d5aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:48.981977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94b495-26bb-47ff-a8aa-8eaa347d5aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:48.986006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94b495-26bb-47ff-a8aa-8eaa347d5aea service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:48.996407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 869/1747] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:50.329072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e558f-b024-4523-8bb4-6f689746f2bc service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:50.341390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e558f-b024-4523-8bb4-6f689746f2bc service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:50.354042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb955b-3057-44e1-a032-7da8655ffa1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:50.354042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb955b-3057-44e1-a032-7da8655ffa1c service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:50.354042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb955b-3057-44e1-a032-7da8655ffa1c service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:50.354042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb955b-3057-44e1-a032-7da8655ffa1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:50.434122 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb955b-3057-44e1-a032-7da8655ffa1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:50.450952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb955b-3057-44e1-a032-7da8655ffa1c service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:50.467454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 879/1748] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:51.516749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:51.526490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb52688-a8a8-422a-8e93-bb205453fbcf None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:51.526685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb52688-a8a8-422a-8e93-bb205453fbcf None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:51.527107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb52688-a8a8-422a-8e93-bb205453fbcf None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:51.528887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 870/1749] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 15:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:51.583580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30897aa-b2ad-4d8e-ae7f-6bc43688ab32 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:51.585396 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30897aa-b2ad-4d8e-ae7f-6bc43688ab32 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:51.585920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30897aa-b2ad-4d8e-ae7f-6bc43688ab32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:51.639790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d30897aa-b2ad-4d8e-ae7f-6bc43688ab32 None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:51.644790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d30897aa-b2ad-4d8e-ae7f-6bc43688ab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:51.730483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e1e5-8532-43c0-bf9c-0b42fd489534 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:51.730927 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e1e5-8532-43c0-bf9c-0b42fd489534 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:51.731299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e1e5-8532-43c0-bf9c-0b42fd489534 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:51.733142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 871/1750] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 15:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:51.829404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ea5ae-0fc8-4937-863b-b3b0d039ad9c None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:51.845771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ea5ae-0fc8-4937-863b-b3b0d039ad9c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:51.845771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ea5ae-0fc8-4937-863b-b3b0d039ad9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:51.846154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 880/1751] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 15:57:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:57:51.877804 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-213ea5ae-0fc8-4937-863b-b3b0d039ad9c None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:51.879907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-213ea5ae-0fc8-4937-863b-b3b0d039ad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:51.894578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 872/1752] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 15:57:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:57:52.069020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30897aa-b2ad-4d8e-ae7f-6bc43688ab32 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:52.072950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d30897aa-b2ad-4d8e-ae7f-6bc43688ab32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:52.107001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30897aa-b2ad-4d8e-ae7f-6bc43688ab32 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:52.119106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa57be2-f5d0-4fe8-bcca-9d1876fd7d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:52.120161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa57be2-f5d0-4fe8-bcca-9d1876fd7d34 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:52.120653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa57be2-f5d0-4fe8-bcca-9d1876fd7d34 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:52.121083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa57be2-f5d0-4fe8-bcca-9d1876fd7d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:52.145530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa57be2-f5d0-4fe8-bcca-9d1876fd7d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:52.149680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa57be2-f5d0-4fe8-bcca-9d1876fd7d34 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:52.158831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ea5ae-0fc8-4937-863b-b3b0d039ad9c None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:52.172204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-213ea5ae-0fc8-4937-863b-b3b0d039ad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:52.191157 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ea5ae-0fc8-4937-863b-b3b0d039ad9c None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:52.195720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 881/1753] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:52.219230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677702-0307-4dc7-b194-91fec2a4a49e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:52.220886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677702-0307-4dc7-b194-91fec2a4a49e service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:52.221344 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677702-0307-4dc7-b194-91fec2a4a49e service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:52.221852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677702-0307-4dc7-b194-91fec2a4a49e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:52.247425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677702-0307-4dc7-b194-91fec2a4a49e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:52.251814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677702-0307-4dc7-b194-91fec2a4a49e service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:52.299613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 873/1754] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:57:52.908113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:55.373347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa57be2-f5d0-4fe8-bcca-9d1876fd7d34 service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:55.376154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-afa57be2-f5d0-4fe8-bcca-9d1876fd7d34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:55.476148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa57be2-f5d0-4fe8-bcca-9d1876fd7d34 service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:55.482654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:55.483491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:55.483784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:55.484056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] PATH_INFO: `/v3/users/d6550138725d45f3b45101c304b64b83` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:55.485288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6550138725d45f3b45101c304b64b83)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:55.487308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:55.946232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6550138725d45f3b45101c304b64b83'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:55.955662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6550138725d45f3b45101c304b64b83'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:56.162459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6550138725d45f3b45101c304b64b83'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:56.163576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6550138725d45f3b45101c304b64b83'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:56.164228 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6550138725d45f3b45101c304b64b83'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:56.184346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 882/1755] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:57:55 2022] DELETE /identity/v3/users/d6550138725d45f3b45101c304b64b83 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:56.189047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2949-438e-4a21-a2ed-eee1f629d3c0 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:56.189693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2949-438e-4a21-a2ed-eee1f629d3c0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:56.189693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2949-438e-4a21-a2ed-eee1f629d3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:56.210622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-0dca2949-438e-4a21-a2ed-eee1f629d3c0 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:56.212595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0dca2949-438e-4a21-a2ed-eee1f629d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:56.283736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 874/1756] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:56.306252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:56.307748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:56.389894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beffeb2-9201-4f3a-85d4-3756c6c81bb0 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:56.394634 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8b6be-441c-49ca-ac3b-c0d77bfd6c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:56.396148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8b6be-441c-49ca-ac3b-c0d77bfd6c16 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:56.396505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8b6be-441c-49ca-ac3b-c0d77bfd6c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:56.397032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8b6be-441c-49ca-ac3b-c0d77bfd6c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:56.418536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8b6be-441c-49ca-ac3b-c0d77bfd6c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:56.420305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8b6be-441c-49ca-ac3b-c0d77bfd6c16 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:56.438010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 883/1757] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:57.597873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca2949-438e-4a21-a2ed-eee1f629d3c0 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:57.600231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0dca2949-438e-4a21-a2ed-eee1f629d3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:57.615728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca2949-438e-4a21-a2ed-eee1f629d3c0 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:57.621267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:57.621811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:57.622085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:57.622390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] PATH_INFO: `/v3/projects/b3e84ec2796240c2b15085d71a024ab4` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:57.623589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e84ec2796240c2b15085d71a024ab4)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:57.625613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:58.702952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e84ec2796240c2b15085d71a024ab4', 'request_id': 'req-a3a85944-91c8-4410-8f25-95ef6ba2ba27'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:58.954567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e84ec2796240c2b15085d71a024ab4', 'request_id': 'req-a3a85944-91c8-4410-8f25-95ef6ba2ba27'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:58.961878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e84ec2796240c2b15085d71a024ab4', 'request_id': 'req-a3a85944-91c8-4410-8f25-95ef6ba2ba27'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:58.973173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] The token cache is being invalidate because project b3e84ec2796240c2b15085d71a024ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:57:58.973984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:58.974758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:58.976266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 875/1758] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:57:57 2022] DELETE /identity/v3/projects/b3e84ec2796240c2b15085d71a024ab4 => generated 0 bytes in 1381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:57:58.980285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8b6be-441c-49ca-ac3b-c0d77bfd6c16 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:58.990802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8b6be-441c-49ca-ac3b-c0d77bfd6c16 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:59.053415 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:59.054407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:59.054988 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:59.055586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] PATH_INFO: `/v3/users/62b8bf0da05d4d01be3f4137ae39b7b0` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:59.057013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b8bf0da05d4d01be3f4137ae39b7b0)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:59.059274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:59.427257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b8bf0da05d4d01be3f4137ae39b7b0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:59.437232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b8bf0da05d4d01be3f4137ae39b7b0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:59.581846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b8bf0da05d4d01be3f4137ae39b7b0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:59.582485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b8bf0da05d4d01be3f4137ae39b7b0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:59.583142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0541ce9-46d7-42fc-b4e8-22ecb46b6e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b8bf0da05d4d01be3f4137ae39b7b0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:57:59.602991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 884/1759] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:57:58 2022] DELETE /identity/v3/users/62b8bf0da05d4d01be3f4137ae39b7b0 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:00.193030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:00.194403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:00.208396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a85944-91c8-4410-8f25-95ef6ba2ba27 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:00.265310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:00.265942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:00.266218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:00.266569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] PATH_INFO: `/v3/projects/56b009acad1b43ae8f4edca0082f6c41` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:00.267687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b009acad1b43ae8f4edca0082f6c41)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:00.269609 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:00.469148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:00.475415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b009acad1b43ae8f4edca0082f6c41', 'request_id': 'req-12c3abda-ffe1-4d49-87cf-bff8336bc333'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:00.600017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b009acad1b43ae8f4edca0082f6c41', 'request_id': 'req-12c3abda-ffe1-4d49-87cf-bff8336bc333'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:00.607155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b009acad1b43ae8f4edca0082f6c41', 'request_id': 'req-12c3abda-ffe1-4d49-87cf-bff8336bc333'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:00.617761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] The token cache is being invalidate because project 56b009acad1b43ae8f4edca0082f6c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:00.618064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:00.618720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-12c3abda-ffe1-4d49-87cf-bff8336bc333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:00.620218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 876/1760] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:00 2022] DELETE /identity/v3/projects/56b009acad1b43ae8f4edca0082f6c41 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:00.625290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad575ef0-da39-49bb-8193-77db8dbf960f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:00.625771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad575ef0-da39-49bb-8193-77db8dbf960f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:00.625870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad575ef0-da39-49bb-8193-77db8dbf960f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:00.645978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-ad575ef0-da39-49bb-8193-77db8dbf960f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:00.647716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ad575ef0-da39-49bb-8193-77db8dbf960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:00.707658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 885/1761] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:00.716188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ec4d-13b9-4ad5-b00e-19ae51b7e7ae None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:00.716470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ec4d-13b9-4ad5-b00e-19ae51b7e7ae None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:00.716776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ec4d-13b9-4ad5-b00e-19ae51b7e7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:00.743078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-dba4ec4d-13b9-4ad5-b00e-19ae51b7e7ae None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:00.744385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-dba4ec4d-13b9-4ad5-b00e-19ae51b7e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:00.752460 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 877/1762] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:00.757500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad575ef0-da39-49bb-8193-77db8dbf960f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:00.767138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad575ef0-da39-49bb-8193-77db8dbf960f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:00.772336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ec249-bd35-4c6d-a017-cc603e1db250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:00.773086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec249-bd35-4c6d-a017-cc603e1db250 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:00.773292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec249-bd35-4c6d-a017-cc603e1db250 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:00.773558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec249-bd35-4c6d-a017-cc603e1db250 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:00.774200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ec249-bd35-4c6d-a017-cc603e1db250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:00.774501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ec249-bd35-4c6d-a017-cc603e1db250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:00.776088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ec249-bd35-4c6d-a017-cc603e1db250 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:00.788086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 886/1763] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:00.797776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ec4d-13b9-4ad5-b00e-19ae51b7e7ae None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:00.808115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ec4d-13b9-4ad5-b00e-19ae51b7e7ae None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:00.812995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bd718-0e30-4751-995e-cb0419e74023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:00.813730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bd718-0e30-4751-995e-cb0419e74023 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:00.814009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bd718-0e30-4751-995e-cb0419e74023 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:00.814275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bd718-0e30-4751-995e-cb0419e74023 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:00.814911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bd718-0e30-4751-995e-cb0419e74023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:00.817086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bd718-0e30-4751-995e-cb0419e74023 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:01.008464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 878/1764] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:00 2022] POST /identity/v3/projects => generated 409 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:01.012829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ec249-bd35-4c6d-a017-cc603e1db250 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:01.023644 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ec249-bd35-4c6d-a017-cc603e1db250 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:01.081836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776b527-a3d4-435f-8416-bb3ee12b87c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:01.082518 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b527-a3d4-435f-8416-bb3ee12b87c9 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:01.082949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b527-a3d4-435f-8416-bb3ee12b87c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:01.083230 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b527-a3d4-435f-8416-bb3ee12b87c9 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:01.083984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776b527-a3d4-435f-8416-bb3ee12b87c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:01.085885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776b527-a3d4-435f-8416-bb3ee12b87c9 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:01.319224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 887/1765] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:01 2022] POST /identity/v3/users => generated 305 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:01.322530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bd718-0e30-4751-995e-cb0419e74023 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:01.331936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bd718-0e30-4751-995e-cb0419e74023 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:01.336634 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272f420-62b6-47aa-a2c2-58dcde8430df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:01.337254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272f420-62b6-47aa-a2c2-58dcde8430df admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:01.337711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272f420-62b6-47aa-a2c2-58dcde8430df admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:01.337988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272f420-62b6-47aa-a2c2-58dcde8430df admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:01.338643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272f420-62b6-47aa-a2c2-58dcde8430df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:01.340256 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272f420-62b6-47aa-a2c2-58dcde8430df admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:01.354090 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 879/1766] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:58:01.355442 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776b527-a3d4-435f-8416-bb3ee12b87c9 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:01.366783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776b527-a3d4-435f-8416-bb3ee12b87c9 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:01.372056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2eadc-9b24-4ebf-84f7-205bac4474c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:01.373021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2eadc-9b24-4ebf-84f7-205bac4474c1 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:01.373170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2eadc-9b24-4ebf-84f7-205bac4474c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:01.373603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2eadc-9b24-4ebf-84f7-205bac4474c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:01.374258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2eadc-9b24-4ebf-84f7-205bac4474c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:01.376573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2eadc-9b24-4ebf-84f7-205bac4474c1 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:01.397346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 888/1767] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:01.397513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272f420-62b6-47aa-a2c2-58dcde8430df admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:01.403456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272f420-62b6-47aa-a2c2-58dcde8430df admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:01.408220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3193552-f06b-4772-8d35-321f2ee58348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:01.408912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193552-f06b-4772-8d35-321f2ee58348 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:01.409190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193552-f06b-4772-8d35-321f2ee58348 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:01.409466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193552-f06b-4772-8d35-321f2ee58348 admin admin] PATH_INFO: `/v3/projects/6745cb90651445e4893845de839c2916/users/196da6f7658546babb0d776bc5ece6f8/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:01.424777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3193552-f06b-4772-8d35-321f2ee58348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6745cb90651445e4893845de839c2916, user_id=196da6f7658546babb0d776bc5ece6f8, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:01.427647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3193552-f06b-4772-8d35-321f2ee58348 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:01.565984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 880/1768] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:01 2022] PUT /identity/v3/projects/6745cb90651445e4893845de839c2916/users/196da6f7658546babb0d776bc5ece6f8/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:01.577708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b969eb-9baa-47d9-9610-012e79b35b93 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:01.578242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b969eb-9baa-47d9-9610-012e79b35b93 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:01.578729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b969eb-9baa-47d9-9610-012e79b35b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:01.624706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b0b969eb-9baa-47d9-9610-012e79b35b93 None None] MFA Rules not processed for user `196da6f7658546babb0d776bc5ece6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:01.626283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b0b969eb-9baa-47d9-9610-012e79b35b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:01.774462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 889/1769] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:01 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:01.780316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3193552-f06b-4772-8d35-321f2ee58348 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:01.877294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3193552-f06b-4772-8d35-321f2ee58348 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:01.879893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379a002-9a72-4c40-8e7d-3614434f88a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:01.880500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379a002-9a72-4c40-8e7d-3614434f88a7 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:01.880807 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379a002-9a72-4c40-8e7d-3614434f88a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:01.881100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379a002-9a72-4c40-8e7d-3614434f88a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:01.881711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379a002-9a72-4c40-8e7d-3614434f88a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:01.883621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379a002-9a72-4c40-8e7d-3614434f88a7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:02.039585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 881/1770] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:01 2022] POST /identity/v3/projects => generated 407 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:02.040638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b969eb-9baa-47d9-9610-012e79b35b93 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:02.051355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b969eb-9baa-47d9-9610-012e79b35b93 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:02.112127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eecf70-cdf8-4c14-8f8a-fc40d6161e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:02.112853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eecf70-cdf8-4c14-8f8a-fc40d6161e2b admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:02.113172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eecf70-cdf8-4c14-8f8a-fc40d6161e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:02.113402 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eecf70-cdf8-4c14-8f8a-fc40d6161e2b admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:02.114769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eecf70-cdf8-4c14-8f8a-fc40d6161e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:02.116712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eecf70-cdf8-4c14-8f8a-fc40d6161e2b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:02.281736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 890/1771] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:02 2022] POST /identity/v3/users => generated 310 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:02.286489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379a002-9a72-4c40-8e7d-3614434f88a7 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:02.297385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379a002-9a72-4c40-8e7d-3614434f88a7 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:02.302050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea942d-9bd6-4c37-8604-5c9cd97389fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:02.302654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea942d-9bd6-4c37-8604-5c9cd97389fd admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:02.303187 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea942d-9bd6-4c37-8604-5c9cd97389fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:02.303456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea942d-9bd6-4c37-8604-5c9cd97389fd admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:02.304100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea942d-9bd6-4c37-8604-5c9cd97389fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:02.305756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea942d-9bd6-4c37-8604-5c9cd97389fd admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:02.321362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 882/1772] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:02.322390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eecf70-cdf8-4c14-8f8a-fc40d6161e2b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:02.332537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eecf70-cdf8-4c14-8f8a-fc40d6161e2b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:02.346816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d8a1a-bcee-4ffe-a5af-e9775f7bb93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:02.347531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d8a1a-bcee-4ffe-a5af-e9775f7bb93e admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:02.347781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d8a1a-bcee-4ffe-a5af-e9775f7bb93e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:02.348050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d8a1a-bcee-4ffe-a5af-e9775f7bb93e admin admin] PATH_INFO: `/v3/projects/df75511ec8c64ce0b51b081f6366b572/users/847af6440e444d27921a299b5a69102e/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:02.365543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d8a1a-bcee-4ffe-a5af-e9775f7bb93e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df75511ec8c64ce0b51b081f6366b572, user_id=847af6440e444d27921a299b5a69102e, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:02.368499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d8a1a-bcee-4ffe-a5af-e9775f7bb93e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:02.603517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea942d-9bd6-4c37-8604-5c9cd97389fd admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:02.604014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 891/1773] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:02 2022] PUT /identity/v3/projects/df75511ec8c64ce0b51b081f6366b572/users/847af6440e444d27921a299b5a69102e/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:02.616192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea942d-9bd6-4c37-8604-5c9cd97389fd admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:02.685264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026870ce-df8d-4c72-9f1c-a643d77e3595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:02.685880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026870ce-df8d-4c72-9f1c-a643d77e3595 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:02.686160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026870ce-df8d-4c72-9f1c-a643d77e3595 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:02.686610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026870ce-df8d-4c72-9f1c-a643d77e3595 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:02.687263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026870ce-df8d-4c72-9f1c-a643d77e3595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:02.689067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026870ce-df8d-4c72-9f1c-a643d77e3595 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:02.699750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 883/1774] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:02.704313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d8a1a-bcee-4ffe-a5af-e9775f7bb93e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:02.716037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d8a1a-bcee-4ffe-a5af-e9775f7bb93e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:02.734653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c46a60-43e9-4976-a7c5-b393e871fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:02.735569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c46a60-43e9-4976-a7c5-b393e871fae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:02.735922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c46a60-43e9-4976-a7c5-b393e871fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:02.736264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c46a60-43e9-4976-a7c5-b393e871fae2 admin admin] PATH_INFO: `/v3/projects/df75511ec8c64ce0b51b081f6366b572/users/847af6440e444d27921a299b5a69102e/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:02.738463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c46a60-43e9-4976-a7c5-b393e871fae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df75511ec8c64ce0b51b081f6366b572, user_id=847af6440e444d27921a299b5a69102e, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:02.741842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c46a60-43e9-4976-a7c5-b393e871fae2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:02.763602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 892/1775] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:02 2022] PUT /identity/v3/projects/df75511ec8c64ce0b51b081f6366b572/users/847af6440e444d27921a299b5a69102e/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:02.766702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e9f61-355d-40d5-bbb1-ecdc0298df26 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:02.766984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e9f61-355d-40d5-bbb1-ecdc0298df26 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:02.767252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e9f61-355d-40d5-bbb1-ecdc0298df26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:02.807327 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-171e9f61-355d-40d5-bbb1-ecdc0298df26 None None] MFA Rules not processed for user `847af6440e444d27921a299b5a69102e`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:02.808788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-171e9f61-355d-40d5-bbb1-ecdc0298df26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:02.878165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:02.956605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 884/1776] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:02 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:02.967865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c46a60-43e9-4976-a7c5-b393e871fae2 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:02.972284 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a8c46a60-43e9-4976-a7c5-b393e871fae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:03.045429 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c46a60-43e9-4976-a7c5-b393e871fae2 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:03.049876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84803103-28b2-4772-b03a-8c13eb20ea98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:03.050565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84803103-28b2-4772-b03a-8c13eb20ea98 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:03.050854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84803103-28b2-4772-b03a-8c13eb20ea98 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:03.051124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84803103-28b2-4772-b03a-8c13eb20ea98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:03.063309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84803103-28b2-4772-b03a-8c13eb20ea98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:03.064807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84803103-28b2-4772-b03a-8c13eb20ea98 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:03.079137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 893/1777] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:02 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:03.709368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e9f61-355d-40d5-bbb1-ecdc0298df26 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:03.719580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e9f61-355d-40d5-bbb1-ecdc0298df26 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:03.723358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288974c-179c-4043-bd25-70c3823bc6a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:03.723980 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288974c-179c-4043-bd25-70c3823bc6a0 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:03.724254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288974c-179c-4043-bd25-70c3823bc6a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:03.724558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288974c-179c-4043-bd25-70c3823bc6a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:03.786100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288974c-179c-4043-bd25-70c3823bc6a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:03.787551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288974c-179c-4043-bd25-70c3823bc6a0 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:03.797813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 885/1778] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:03 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:04.463019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758de2-dc1c-4c85-b74f-ac16a4896a97 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:04.463477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758de2-dc1c-4c85-b74f-ac16a4896a97 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:04.463580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758de2-dc1c-4c85-b74f-ac16a4896a97 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:04.464915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 894/1779] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 15:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:58:04.488431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3328c5-70a6-4c65-9c33-b5356a818f19 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:04.488741 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3328c5-70a6-4c65-9c33-b5356a818f19 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:04.489015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3328c5-70a6-4c65-9c33-b5356a818f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:04.509869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8b3328c5-70a6-4c65-9c33-b5356a818f19 None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:04.511168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8b3328c5-70a6-4c65-9c33-b5356a818f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:04.586738 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 886/1780] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 15:58:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:58:04.601466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c758de2-dc1c-4c85-b74f-ac16a4896a97 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:04.603919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2c758de2-dc1c-4c85-b74f-ac16a4896a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:04.624390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c758de2-dc1c-4c85-b74f-ac16a4896a97 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:04.629939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97667c-63c7-4f43-90ed-4cd321ffc6d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:04.630539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97667c-63c7-4f43-90ed-4cd321ffc6d8 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:04.630819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97667c-63c7-4f43-90ed-4cd321ffc6d8 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:04.631094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97667c-63c7-4f43-90ed-4cd321ffc6d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:04.640348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97667c-63c7-4f43-90ed-4cd321ffc6d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:04.641968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97667c-63c7-4f43-90ed-4cd321ffc6d8 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:04.653547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 895/1781] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:07.624640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3328c5-70a6-4c65-9c33-b5356a818f19 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:07.626037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8b3328c5-70a6-4c65-9c33-b5356a818f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:07.651893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:07.693928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3328c5-70a6-4c65-9c33-b5356a818f19 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:07.698612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:07.699255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:07.699550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:07.699805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] PATH_INFO: `/v3/users/c1448341b0cd4e6a8a00c6e6c42a6e6c` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:07.701084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1448341b0cd4e6a8a00c6e6c42a6e6c)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:07.703146 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:07.984892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1448341b0cd4e6a8a00c6e6c42a6e6c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:07.997357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1448341b0cd4e6a8a00c6e6c42a6e6c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:08.091428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1448341b0cd4e6a8a00c6e6c42a6e6c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:08.092085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1448341b0cd4e6a8a00c6e6c42a6e6c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:08.100403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1448341b0cd4e6a8a00c6e6c42a6e6c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:08.106800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 887/1782] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:07 2022] DELETE /identity/v3/users/c1448341b0cd4e6a8a00c6e6c42a6e6c => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:08.111057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb18e2-c6ec-403b-b596-99be3e95762d None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:08.111345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb18e2-c6ec-403b-b596-99be3e95762d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:08.111619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb18e2-c6ec-403b-b596-99be3e95762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:08.134182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-67fb18e2-c6ec-403b-b596-99be3e95762d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:08.143281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-67fb18e2-c6ec-403b-b596-99be3e95762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:08.206716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 896/1783] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:08.219447 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:08.220954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:08.285090 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256ddb3-57d9-459c-8179-1b785cd0334f admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:08.289063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284682da-669f-4215-8bb5-81938a2f5356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:08.293879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284682da-669f-4215-8bb5-81938a2f5356 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:08.293879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284682da-669f-4215-8bb5-81938a2f5356 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:08.293879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284682da-669f-4215-8bb5-81938a2f5356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:08.299575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284682da-669f-4215-8bb5-81938a2f5356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:08.301607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284682da-669f-4215-8bb5-81938a2f5356 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:08.312177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 888/1784] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:08.389039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:08.829356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb18e2-c6ec-403b-b596-99be3e95762d None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:08.832016 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-67fb18e2-c6ec-403b-b596-99be3e95762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:08.854372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb18e2-c6ec-403b-b596-99be3e95762d None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:08.861958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:08.867070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:08.867070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:08.867070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] PATH_INFO: `/v3/projects/d8cd6e1b75894bd9bcff58bb7505fdb6` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:08.867070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8cd6e1b75894bd9bcff58bb7505fdb6)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:08.870220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:09.037406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8cd6e1b75894bd9bcff58bb7505fdb6', 'request_id': 'req-828c1906-48c9-4744-99c5-9b450c615975'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:09.047241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8cd6e1b75894bd9bcff58bb7505fdb6', 'request_id': 'req-828c1906-48c9-4744-99c5-9b450c615975'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:09.065794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8cd6e1b75894bd9bcff58bb7505fdb6', 'request_id': 'req-828c1906-48c9-4744-99c5-9b450c615975'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:09.182702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] The token cache is being invalidate because project d8cd6e1b75894bd9bcff58bb7505fdb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:09.182702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:09.182702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:09.183162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 897/1785] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:08 2022] DELETE /identity/v3/projects/d8cd6e1b75894bd9bcff58bb7505fdb6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:09.187877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284682da-669f-4215-8bb5-81938a2f5356 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:09.199959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284682da-669f-4215-8bb5-81938a2f5356 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:09.259567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:09.260406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:09.260901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:09.261182 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] PATH_INFO: `/v3/users/11e685cff40d43c0bc682d367dbe0c3e` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:09.262371 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e685cff40d43c0bc682d367dbe0c3e)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:09.264707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:09.742052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e685cff40d43c0bc682d367dbe0c3e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:09.759316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e685cff40d43c0bc682d367dbe0c3e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:09.924644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e685cff40d43c0bc682d367dbe0c3e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:09.924644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e685cff40d43c0bc682d367dbe0c3e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:09.939637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e9dc4948-8871-44bf-805f-51d2cd83e101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e685cff40d43c0bc682d367dbe0c3e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:09.950235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 889/1786] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:09 2022] DELETE /identity/v3/users/11e685cff40d43c0bc682d367dbe0c3e => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:10.667841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:10.670183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:10.707840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c1906-48c9-4744-99c5-9b450c615975 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:10.798054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:10.798845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:10.799199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:10.799539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] PATH_INFO: `/v3/projects/a034da0dfcd34f39af49f5e60bc32837` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:10.800825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a034da0dfcd34f39af49f5e60bc32837)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:10.803240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:10.989630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a034da0dfcd34f39af49f5e60bc32837', 'request_id': 'req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:10.997302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a034da0dfcd34f39af49f5e60bc32837', 'request_id': 'req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:11.005232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a034da0dfcd34f39af49f5e60bc32837', 'request_id': 'req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:11.194883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] The token cache is being invalidate because project a034da0dfcd34f39af49f5e60bc32837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:11.194883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:11.194883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f2ea6f6e-83f8-409b-9f5c-ea49daeb7f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:11.194883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 898/1787] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:10 2022] DELETE /identity/v3/projects/a034da0dfcd34f39af49f5e60bc32837 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:11.198473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88f5ee-074b-48d7-ac4c-996b6825a267 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:11.198916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88f5ee-074b-48d7-ac4c-996b6825a267 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:11.199141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88f5ee-074b-48d7-ac4c-996b6825a267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:11.233331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ef88f5ee-074b-48d7-ac4c-996b6825a267 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:11.234578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ef88f5ee-074b-48d7-ac4c-996b6825a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:11.301865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 890/1788] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:11.310229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb67e2-6083-4e46-9f19-4b37c7556f5d None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:11.310517 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb67e2-6083-4e46-9f19-4b37c7556f5d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:11.310840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb67e2-6083-4e46-9f19-4b37c7556f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:11.336407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c5fb67e2-6083-4e46-9f19-4b37c7556f5d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:11.337774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c5fb67e2-6083-4e46-9f19-4b37c7556f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:11.346326 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 899/1789] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:11.350902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88f5ee-074b-48d7-ac4c-996b6825a267 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:11.360857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88f5ee-074b-48d7-ac4c-996b6825a267 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:11.366240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302e186-0f9b-4e45-88e3-83bce7ca6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:11.366844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302e186-0f9b-4e45-88e3-83bce7ca6aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:11.367151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302e186-0f9b-4e45-88e3-83bce7ca6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:11.367424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302e186-0f9b-4e45-88e3-83bce7ca6aa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:11.368101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302e186-0f9b-4e45-88e3-83bce7ca6aa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:11.368403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302e186-0f9b-4e45-88e3-83bce7ca6aa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:11.370281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302e186-0f9b-4e45-88e3-83bce7ca6aa5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:11.382637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 891/1790] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:11.387440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb67e2-6083-4e46-9f19-4b37c7556f5d None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:11.396958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb67e2-6083-4e46-9f19-4b37c7556f5d None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:11.401906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d341d7-5ee9-43ce-8078-1528b5271f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:11.407364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d341d7-5ee9-43ce-8078-1528b5271f5e admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:11.407364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d341d7-5ee9-43ce-8078-1528b5271f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:11.407364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d341d7-5ee9-43ce-8078-1528b5271f5e admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:11.407364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d341d7-5ee9-43ce-8078-1528b5271f5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:11.407364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d341d7-5ee9-43ce-8078-1528b5271f5e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:11.485619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:11.527177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 900/1791] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:11 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:11.531599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302e186-0f9b-4e45-88e3-83bce7ca6aa5 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:11.542494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302e186-0f9b-4e45-88e3-83bce7ca6aa5 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:11.598781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e895c6-8111-47d7-af26-900a2e784e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:11.602290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e895c6-8111-47d7-af26-900a2e784e19 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:11.602290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e895c6-8111-47d7-af26-900a2e784e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:11.602290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e895c6-8111-47d7-af26-900a2e784e19 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:11.602290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e895c6-8111-47d7-af26-900a2e784e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:11.609731 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e895c6-8111-47d7-af26-900a2e784e19 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:11.731514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 892/1792] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:11 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:11.736596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d341d7-5ee9-43ce-8078-1528b5271f5e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:11.747848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d341d7-5ee9-43ce-8078-1528b5271f5e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:11.752949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f598f5-d200-4223-adf4-24285f454b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:11.753803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f598f5-d200-4223-adf4-24285f454b2d admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:11.754253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f598f5-d200-4223-adf4-24285f454b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:11.754525 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f598f5-d200-4223-adf4-24285f454b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:11.755168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f598f5-d200-4223-adf4-24285f454b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:11.756978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f598f5-d200-4223-adf4-24285f454b2d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:11.767559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 901/1793] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:11.777633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e895c6-8111-47d7-af26-900a2e784e19 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:11.788876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e895c6-8111-47d7-af26-900a2e784e19 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:11.794335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615924f4-81af-43bb-83a0-1832e50e76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:11.795186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615924f4-81af-43bb-83a0-1832e50e76d6 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:11.795562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615924f4-81af-43bb-83a0-1832e50e76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:11.795991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615924f4-81af-43bb-83a0-1832e50e76d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:11.796941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615924f4-81af-43bb-83a0-1832e50e76d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:11.799019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615924f4-81af-43bb-83a0-1832e50e76d6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:11.815348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 893/1794] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:11.817256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f598f5-d200-4223-adf4-24285f454b2d admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:11.828338 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f598f5-d200-4223-adf4-24285f454b2d admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:11.834549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fba358-c240-4e7d-9771-356376c32564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:11.835206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba358-c240-4e7d-9771-356376c32564 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:11.835704 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba358-c240-4e7d-9771-356376c32564 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:11.836274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba358-c240-4e7d-9771-356376c32564 admin admin] PATH_INFO: `/v3/projects/0253292f54ea43658c8b1d7ee6fdbf72/users/f3b597a5a4744f45af7d8315a7faa8d3/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:11.872001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fba358-c240-4e7d-9771-356376c32564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0253292f54ea43658c8b1d7ee6fdbf72, user_id=f3b597a5a4744f45af7d8315a7faa8d3, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:11.880574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fba358-c240-4e7d-9771-356376c32564 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:11.977693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 902/1795] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:11 2022] PUT /identity/v3/projects/0253292f54ea43658c8b1d7ee6fdbf72/users/f3b597a5a4744f45af7d8315a7faa8d3/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:11.988352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a99d1-f3d3-4aae-98e3-573b6fbba008 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:11.988593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a99d1-f3d3-4aae-98e3-573b6fbba008 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:11.988871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a99d1-f3d3-4aae-98e3-573b6fbba008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:12.037290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a83a99d1-f3d3-4aae-98e3-573b6fbba008 None None] MFA Rules not processed for user `f3b597a5a4744f45af7d8315a7faa8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:12.037290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a83a99d1-f3d3-4aae-98e3-573b6fbba008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:12.119886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 894/1796] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:12.124302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fba358-c240-4e7d-9771-356376c32564 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:12.209529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fba358-c240-4e7d-9771-356376c32564 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:12.215317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b90e-7f8f-42cc-83c8-a33b1ceac09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:12.216148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b90e-7f8f-42cc-83c8-a33b1ceac09b admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:12.216780 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b90e-7f8f-42cc-83c8-a33b1ceac09b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:12.217239 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b90e-7f8f-42cc-83c8-a33b1ceac09b admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:12.218024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b90e-7f8f-42cc-83c8-a33b1ceac09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:12.220670 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b90e-7f8f-42cc-83c8-a33b1ceac09b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:12.424763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 903/1797] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:12 2022] POST /identity/v3/projects => generated 379 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:12.429262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a99d1-f3d3-4aae-98e3-573b6fbba008 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:12.441173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a99d1-f3d3-4aae-98e3-573b6fbba008 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:12.511891 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9b5c0-1e65-41f4-8edc-1d70d72140cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:12.512732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b5c0-1e65-41f4-8edc-1d70d72140cc admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:12.513021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b5c0-1e65-41f4-8edc-1d70d72140cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:12.513297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b5c0-1e65-41f4-8edc-1d70d72140cc admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:12.513941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9b5c0-1e65-41f4-8edc-1d70d72140cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:12.515937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9b5c0-1e65-41f4-8edc-1d70d72140cc admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:12.619655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 895/1798] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:12 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:12.624300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b90e-7f8f-42cc-83c8-a33b1ceac09b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:12.636042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b90e-7f8f-42cc-83c8-a33b1ceac09b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:12.640919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92f5a0-5409-4e38-b93e-e448783aa7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:12.641758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f5a0-5409-4e38-b93e-e448783aa7fe admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:12.642127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f5a0-5409-4e38-b93e-e448783aa7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:12.642468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92f5a0-5409-4e38-b93e-e448783aa7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:12.643187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92f5a0-5409-4e38-b93e-e448783aa7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:12.645723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92f5a0-5409-4e38-b93e-e448783aa7fe admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:12.663089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9b5c0-1e65-41f4-8edc-1d70d72140cc admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:12.664158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 904/1799] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:12.673806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9b5c0-1e65-41f4-8edc-1d70d72140cc admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:12.680016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ef548-0b6d-4535-86f2-ac1fde7ee3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:12.680724 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ef548-0b6d-4535-86f2-ac1fde7ee3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:12.681007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ef548-0b6d-4535-86f2-ac1fde7ee3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:12.681386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ef548-0b6d-4535-86f2-ac1fde7ee3f3 admin admin] PATH_INFO: `/v3/projects/eb6003b54b8f4a3996a27cb7c71467df/users/6671d34188e544a3946d502e1d456fbe/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:12.703663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ef548-0b6d-4535-86f2-ac1fde7ee3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6003b54b8f4a3996a27cb7c71467df, user_id=6671d34188e544a3946d502e1d456fbe, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:12.706543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ef548-0b6d-4535-86f2-ac1fde7ee3f3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:12.900080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 896/1800] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:12 2022] PUT /identity/v3/projects/eb6003b54b8f4a3996a27cb7c71467df/users/6671d34188e544a3946d502e1d456fbe/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:12.902401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92f5a0-5409-4e38-b93e-e448783aa7fe admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:12.918831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92f5a0-5409-4e38-b93e-e448783aa7fe admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:12.989084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceee4af-48ec-409b-bc5f-9d6c22a26aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:12.989695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee4af-48ec-409b-bc5f-9d6c22a26aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:12.990333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee4af-48ec-409b-bc5f-9d6c22a26aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:12.990333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee4af-48ec-409b-bc5f-9d6c22a26aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:12.990846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceee4af-48ec-409b-bc5f-9d6c22a26aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:12.992658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceee4af-48ec-409b-bc5f-9d6c22a26aa4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:13.002969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 905/1801] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:13.008273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ef548-0b6d-4535-86f2-ac1fde7ee3f3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:13.018945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ef548-0b6d-4535-86f2-ac1fde7ee3f3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:13.030991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb979c-6ee1-4cab-99ad-af13089c717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:13.030991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb979c-6ee1-4cab-99ad-af13089c717b admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:13.030991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb979c-6ee1-4cab-99ad-af13089c717b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:13.030991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb979c-6ee1-4cab-99ad-af13089c717b admin admin] PATH_INFO: `/v3/projects/eb6003b54b8f4a3996a27cb7c71467df/users/6671d34188e544a3946d502e1d456fbe/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:13.031407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb979c-6ee1-4cab-99ad-af13089c717b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6003b54b8f4a3996a27cb7c71467df, user_id=6671d34188e544a3946d502e1d456fbe, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:13.031407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb979c-6ee1-4cab-99ad-af13089c717b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:13.042603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 897/1802] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:13 2022] PUT /identity/v3/projects/eb6003b54b8f4a3996a27cb7c71467df/users/6671d34188e544a3946d502e1d456fbe/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:13.054575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6a84-2ec5-44ca-a365-488b66fa3869 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:13.054866 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6a84-2ec5-44ca-a365-488b66fa3869 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:13.055138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6a84-2ec5-44ca-a365-488b66fa3869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:13.081946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-de6e6a84-2ec5-44ca-a365-488b66fa3869 None None] MFA Rules not processed for user `6671d34188e544a3946d502e1d456fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:13.083165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-de6e6a84-2ec5-44ca-a365-488b66fa3869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:13.186030 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 906/1803] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:13.245919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb979c-6ee1-4cab-99ad-af13089c717b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:13.247621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-36bb979c-6ee1-4cab-99ad-af13089c717b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:13.321454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb979c-6ee1-4cab-99ad-af13089c717b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:13.342320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e77d26-81b1-42ae-9747-61dbc1823677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:13.345636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e77d26-81b1-42ae-9747-61dbc1823677 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:13.346405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e77d26-81b1-42ae-9747-61dbc1823677 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:13.347150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e77d26-81b1-42ae-9747-61dbc1823677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:13.372124 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e77d26-81b1-42ae-9747-61dbc1823677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:13.373934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e77d26-81b1-42ae-9747-61dbc1823677 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:13.387485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 898/1804] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:13.663765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:13.885231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e6a84-2ec5-44ca-a365-488b66fa3869 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:13.886756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-de6e6a84-2ec5-44ca-a365-488b66fa3869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:13.987836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e6a84-2ec5-44ca-a365-488b66fa3869 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:13.996050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:13.996050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:13.996050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:13.996050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] PATH_INFO: `/v3/users/196da6f7658546babb0d776bc5ece6f8` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:14.000390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=196da6f7658546babb0d776bc5ece6f8)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:14.001751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:14.384548 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196da6f7658546babb0d776bc5ece6f8'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:14.394841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196da6f7658546babb0d776bc5ece6f8'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:14.569084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196da6f7658546babb0d776bc5ece6f8'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:14.569889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196da6f7658546babb0d776bc5ece6f8'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:14.572132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196da6f7658546babb0d776bc5ece6f8'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:14.616431 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 907/1805] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:13 2022] DELETE /identity/v3/users/196da6f7658546babb0d776bc5ece6f8 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:14.621611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f338a-e70d-455a-815e-927c0c70060d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:14.622218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f338a-e70d-455a-815e-927c0c70060d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:14.622618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f338a-e70d-455a-815e-927c0c70060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:14.652701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-021f338a-e70d-455a-815e-927c0c70060d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:14.654508 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-021f338a-e70d-455a-815e-927c0c70060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:14.748460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:14.750120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 899/1806] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:14.818351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:14.821104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:14.896769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a96cdb-283c-4183-993f-eba5f32feabc admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:14.905724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd9383-5dc2-4b6c-babf-0a81c5a1df5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:14.905724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd9383-5dc2-4b6c-babf-0a81c5a1df5d service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:14.905724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd9383-5dc2-4b6c-babf-0a81c5a1df5d service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:14.905724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd9383-5dc2-4b6c-babf-0a81c5a1df5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:14.916674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd9383-5dc2-4b6c-babf-0a81c5a1df5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:14.924061 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd9383-5dc2-4b6c-babf-0a81c5a1df5d service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:14.930231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 908/1807] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:15.460432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f338a-e70d-455a-815e-927c0c70060d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:15.465441 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-021f338a-e70d-455a-815e-927c0c70060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:15.543614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f338a-e70d-455a-815e-927c0c70060d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:15.548352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4519b-883a-4c82-85cf-a7f475c165f0 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6671d34188e544a3946d502e1d456fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb6003b54b8f4a3996a27cb7c71467df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:15.557249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4519b-883a-4c82-85cf-a7f475c165f0 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:15.557249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4519b-883a-4c82-85cf-a7f475c165f0 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:15.557249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4519b-883a-4c82-85cf-a7f475c165f0 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:15.557249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4519b-883a-4c82-85cf-a7f475c165f0 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:15.557249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4519b-883a-4c82-85cf-a7f475c165f0 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:15.557769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4519b-883a-4c82-85cf-a7f475c165f0 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:15.565143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 900/1808] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:15.570309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd9383-5dc2-4b6c-babf-0a81c5a1df5d service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:15.580968 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd9383-5dc2-4b6c-babf-0a81c5a1df5d service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:15.586541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031f61-e6be-4a37-b939-0f3e372073e5 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6671d34188e544a3946d502e1d456fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb6003b54b8f4a3996a27cb7c71467df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:15.587168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031f61-e6be-4a37-b939-0f3e372073e5 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:15.587449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031f61-e6be-4a37-b939-0f3e372073e5 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:15.587719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031f61-e6be-4a37-b939-0f3e372073e5 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:15.588346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e031f61-e6be-4a37-b939-0f3e372073e5 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:15.591037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e031f61-e6be-4a37-b939-0f3e372073e5 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:15.742224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 909/1809] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:15 2022] POST /identity/v3/projects => generated 355 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:15.742652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4519b-883a-4c82-85cf-a7f475c165f0 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:15.754682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4519b-883a-4c82-85cf-a7f475c165f0 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:15.848874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979fe50-ac4d-4c75-abd7-3068bc9a9d99 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6671d34188e544a3946d502e1d456fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb6003b54b8f4a3996a27cb7c71467df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:15.848874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979fe50-ac4d-4c75-abd7-3068bc9a9d99 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:15.848874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979fe50-ac4d-4c75-abd7-3068bc9a9d99 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:15.849479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979fe50-ac4d-4c75-abd7-3068bc9a9d99 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:15.849479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979fe50-ac4d-4c75-abd7-3068bc9a9d99 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:15.849479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979fe50-ac4d-4c75-abd7-3068bc9a9d99 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:15.849840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979fe50-ac4d-4c75-abd7-3068bc9a9d99 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:15.866287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 901/1810] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:58:15.911773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031f61-e6be-4a37-b939-0f3e372073e5 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:15.923040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031f61-e6be-4a37-b939-0f3e372073e5 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:15.930249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6671d34188e544a3946d502e1d456fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb6003b54b8f4a3996a27cb7c71467df', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:15.931176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:15.931623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:15.931898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] PATH_INFO: `/v3/projects/6e35f58b17cc48cca8eaa1778804d0ef` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:15.933731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e35f58b17cc48cca8eaa1778804d0ef)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:15.935735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:16.090787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979fe50-ac4d-4c75-abd7-3068bc9a9d99 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:16.092314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9979fe50-ac4d-4c75-abd7-3068bc9a9d99 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:16.123127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e35f58b17cc48cca8eaa1778804d0ef', 'request_id': 'req-9b970772-cf86-4703-bf77-a3f106e6d7ea'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:16.138325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e35f58b17cc48cca8eaa1778804d0ef', 'request_id': 'req-9b970772-cf86-4703-bf77-a3f106e6d7ea'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:16.156208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e35f58b17cc48cca8eaa1778804d0ef', 'request_id': 'req-9b970772-cf86-4703-bf77-a3f106e6d7ea'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:16.220985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979fe50-ac4d-4c75-abd7-3068bc9a9d99 tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:16.291624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:16.292656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:16.293130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:16.293406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] PATH_INFO: `/v3/projects/6745cb90651445e4893845de839c2916` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:16.295348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6745cb90651445e4893845de839c2916)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:16.297352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:16.348599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] The token cache is being invalidate because project 6e35f58b17cc48cca8eaa1778804d0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:16.348599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:16.348599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:16.353890 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 910/1811] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:15 2022] DELETE /identity/v3/projects/6e35f58b17cc48cca8eaa1778804d0ef => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:16.531920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:16.639352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6745cb90651445e4893845de839c2916', 'request_id': 'req-fd85ac88-30f4-4847-bcd1-129cca886f95'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:16.863079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6745cb90651445e4893845de839c2916', 'request_id': 'req-fd85ac88-30f4-4847-bcd1-129cca886f95'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:16.882008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6745cb90651445e4893845de839c2916', 'request_id': 'req-fd85ac88-30f4-4847-bcd1-129cca886f95'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:16.895562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] The token cache is being invalidate because project 6745cb90651445e4893845de839c2916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:16.895905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:16.896805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:16.899350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 902/1812] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:16 2022] DELETE /identity/v3/projects/6745cb90651445e4893845de839c2916 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:16.903943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:16.907814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:16.929029 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b970772-cf86-4703-bf77-a3f106e6d7ea tempest-VolumeQuotaClassesTest-699585012 tempest-VolumeQuotaClassesTest-699585012-project-admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:17.006699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46986c20-7564-4a14-8878-411146554385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:17.007590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986c20-7564-4a14-8878-411146554385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:17.007812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986c20-7564-4a14-8878-411146554385 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:17.008114 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986c20-7564-4a14-8878-411146554385 admin admin] PATH_INFO: `/v3/users/847af6440e444d27921a299b5a69102e` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:17.009358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46986c20-7564-4a14-8878-411146554385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=847af6440e444d27921a299b5a69102e)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:17.011579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46986c20-7564-4a14-8878-411146554385 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:17.329316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-46986c20-7564-4a14-8878-411146554385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '847af6440e444d27921a299b5a69102e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:17.344381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-46986c20-7564-4a14-8878-411146554385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '847af6440e444d27921a299b5a69102e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:17.509957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-46986c20-7564-4a14-8878-411146554385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '847af6440e444d27921a299b5a69102e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:17.513246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-46986c20-7564-4a14-8878-411146554385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '847af6440e444d27921a299b5a69102e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:17.514137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-46986c20-7564-4a14-8878-411146554385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '847af6440e444d27921a299b5a69102e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:17.537531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:17.539062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:17.547369 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 911/1813] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:16 2022] DELETE /identity/v3/users/847af6440e444d27921a299b5a69102e => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:17.564123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85ac88-30f4-4847-bcd1-129cca886f95 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:17.652594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:17.653411 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:17.654356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:17.654713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] PATH_INFO: `/v3/users/f3b597a5a4744f45af7d8315a7faa8d3` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:17.656792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b597a5a4744f45af7d8315a7faa8d3)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:17.659667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:18.000425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b597a5a4744f45af7d8315a7faa8d3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:18.014160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b597a5a4744f45af7d8315a7faa8d3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:18.107885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b597a5a4744f45af7d8315a7faa8d3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:18.108613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b597a5a4744f45af7d8315a7faa8d3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:18.116454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b597a5a4744f45af7d8315a7faa8d3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:18.123503 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 903/1814] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:17 2022] DELETE /identity/v3/users/f3b597a5a4744f45af7d8315a7faa8d3 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:18.128367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbfba0-ced9-4ef0-a8cb-207b2abf5901 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:18.128869 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbfba0-ced9-4ef0-a8cb-207b2abf5901 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:18.128969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbfba0-ced9-4ef0-a8cb-207b2abf5901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:18.149967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e8dbfba0-ced9-4ef0-a8cb-207b2abf5901 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:18.151432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e8dbfba0-ced9-4ef0-a8cb-207b2abf5901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:18.175331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:18.177797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:18.246592 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 912/1815] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:18.256692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbfba0-ced9-4ef0-a8cb-207b2abf5901 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:18.258075 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e8dbfba0-ced9-4ef0-a8cb-207b2abf5901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:18.262318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8075518-3f42-4d98-b80b-56eda9c33cb5 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:18.267731 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:18.269859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:18.270199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:18.270635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] PATH_INFO: `/v3/projects/df75511ec8c64ce0b51b081f6366b572` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:18.272397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df75511ec8c64ce0b51b081f6366b572)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:18.274507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:18.322921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbfba0-ced9-4ef0-a8cb-207b2abf5901 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:18.326589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f5241-7fa0-4b67-8ee4-10c52273fdf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:18.327233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f5241-7fa0-4b67-8ee4-10c52273fdf0 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:18.327514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f5241-7fa0-4b67-8ee4-10c52273fdf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:18.327863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f5241-7fa0-4b67-8ee4-10c52273fdf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:18.339505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f5241-7fa0-4b67-8ee4-10c52273fdf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:18.341135 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f5241-7fa0-4b67-8ee4-10c52273fdf0 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:18.351529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 913/1816] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:58:18.463518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df75511ec8c64ce0b51b081f6366b572', 'request_id': 'req-c8198dba-c75e-4d43-858d-35d0d3da4cb5'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:18.589845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df75511ec8c64ce0b51b081f6366b572', 'request_id': 'req-c8198dba-c75e-4d43-858d-35d0d3da4cb5'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:18.591935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:18.598123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df75511ec8c64ce0b51b081f6366b572', 'request_id': 'req-c8198dba-c75e-4d43-858d-35d0d3da4cb5'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:18.608874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] The token cache is being invalidate because project df75511ec8c64ce0b51b081f6366b572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:18.609162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:18.609887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c8198dba-c75e-4d43-858d-35d0d3da4cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:18.611481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 904/1817] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:18 2022] DELETE /identity/v3/projects/df75511ec8c64ce0b51b081f6366b572 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:18.616661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1b187-109a-4141-b786-b672423d6a2e None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:18.616980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1b187-109a-4141-b786-b672423d6a2e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:18.617311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1b187-109a-4141-b786-b672423d6a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:18.654811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-aed1b187-109a-4141-b786-b672423d6a2e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:18.654811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-aed1b187-109a-4141-b786-b672423d6a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:18.757166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 914/1818] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:18.765903 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d781c-f774-4583-8f7d-c71f2830b45c None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:18.766660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d781c-f774-4583-8f7d-c71f2830b45c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:18.767288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d781c-f774-4583-8f7d-c71f2830b45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:18.803936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-084d781c-f774-4583-8f7d-c71f2830b45c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:18.803936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-084d781c-f774-4583-8f7d-c71f2830b45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:18.814255 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1b187-109a-4141-b786-b672423d6a2e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:18.821645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 905/1819] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:18.826044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1b187-109a-4141-b786-b672423d6a2e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:18.835449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86151d-2897-46a0-aa46-77ebaa9c99e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:18.837062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86151d-2897-46a0-aa46-77ebaa9c99e2 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:18.838110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86151d-2897-46a0-aa46-77ebaa9c99e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:18.838488 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86151d-2897-46a0-aa46-77ebaa9c99e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:18.839325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86151d-2897-46a0-aa46-77ebaa9c99e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:18.839743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86151d-2897-46a0-aa46-77ebaa9c99e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:18.841702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86151d-2897-46a0-aa46-77ebaa9c99e2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:18.866270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 915/1820] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:58:18.868225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d781c-f774-4583-8f7d-c71f2830b45c None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:18.880136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d781c-f774-4583-8f7d-c71f2830b45c None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:18.885014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40158f-ca91-4030-800e-7a3927015d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:18.885780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40158f-ca91-4030-800e-7a3927015d3f admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:18.886051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40158f-ca91-4030-800e-7a3927015d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:18.886512 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40158f-ca91-4030-800e-7a3927015d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:18.887143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40158f-ca91-4030-800e-7a3927015d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:18.889426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40158f-ca91-4030-800e-7a3927015d3f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:19.161262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 906/1821] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:18 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:19.165464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86151d-2897-46a0-aa46-77ebaa9c99e2 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:19.176556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86151d-2897-46a0-aa46-77ebaa9c99e2 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:19.206941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:19.227918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40158f-ca91-4030-800e-7a3927015d3f admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:19.233243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6e40158f-ca91-4030-800e-7a3927015d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:19.268373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b342e5-5b3d-4414-961a-05f2ef3f09e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:19.269310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b342e5-5b3d-4414-961a-05f2ef3f09e3 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:19.269762 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b342e5-5b3d-4414-961a-05f2ef3f09e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:19.270037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b342e5-5b3d-4414-961a-05f2ef3f09e3 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:19.270845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b342e5-5b3d-4414-961a-05f2ef3f09e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:19.272858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b342e5-5b3d-4414-961a-05f2ef3f09e3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:19.328621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40158f-ca91-4030-800e-7a3927015d3f admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:19.334663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:19.335688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:19.336077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:19.336497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] PATH_INFO: `/v3/projects/0253292f54ea43658c8b1d7ee6fdbf72` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:19.338282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0253292f54ea43658c8b1d7ee6fdbf72)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:19.340269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:19.422734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 916/1822] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:19 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:19.423663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b342e5-5b3d-4414-961a-05f2ef3f09e3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:19.426268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-51b342e5-5b3d-4414-961a-05f2ef3f09e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:19.439026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b342e5-5b3d-4414-961a-05f2ef3f09e3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:19.444451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:19.445101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:19.445385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:19.445664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] PATH_INFO: `/v3/users/9c9d4f755b2a40c98c00cc5c79063cc4` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:19.452942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9d4f755b2a40c98c00cc5c79063cc4)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:19.452942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:19.493763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0253292f54ea43658c8b1d7ee6fdbf72', 'request_id': 'req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:19.663137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0253292f54ea43658c8b1d7ee6fdbf72', 'request_id': 'req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:19.670268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0253292f54ea43658c8b1d7ee6fdbf72', 'request_id': 'req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:19.681925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] The token cache is being invalidate because project 0253292f54ea43658c8b1d7ee6fdbf72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:19.682235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:19.682878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:19.684434 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 907/1823] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:19 2022] DELETE /identity/v3/projects/0253292f54ea43658c8b1d7ee6fdbf72 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:19.685246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:19.686560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:19.749382 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0029f71-7217-4a1e-a7fc-4ca0ceecc68b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:19.754620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d994b-9370-45ec-b3c6-55648243994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:19.755221 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d994b-9370-45ec-b3c6-55648243994e admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:19.755505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d994b-9370-45ec-b3c6-55648243994e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:19.755805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d994b-9370-45ec-b3c6-55648243994e admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:19.756506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d994b-9370-45ec-b3c6-55648243994e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:19.758201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d994b-9370-45ec-b3c6-55648243994e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:19.769910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 908/1824] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:19.770783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d994b-9370-45ec-b3c6-55648243994e admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:19.772924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4d4d994b-9370-45ec-b3c6-55648243994e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:19.779274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9d4f755b2a40c98c00cc5c79063cc4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:19.785986 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d994b-9370-45ec-b3c6-55648243994e admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:19.786625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9d4f755b2a40c98c00cc5c79063cc4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:19.790748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:19.791359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:19.791635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:19.791903 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] PATH_INFO: `/v3/users/6671d34188e544a3946d502e1d456fbe` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:19.793132 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6671d34188e544a3946d502e1d456fbe)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:19.795032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:19.927320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9d4f755b2a40c98c00cc5c79063cc4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:19.928195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9d4f755b2a40c98c00cc5c79063cc4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:19.928826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9d4f755b2a40c98c00cc5c79063cc4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:19.946988 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 917/1825] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:19 2022] DELETE /identity/v3/users/9c9d4f755b2a40c98c00cc5c79063cc4 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:19.948018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:19.949591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:20.013841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2fc70-1f26-4a30-86c7-36bf659bae87 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:20.018530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b335894-7974-41c8-a198-2d501b95a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:20.019211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b335894-7974-41c8-a198-2d501b95a397 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:20.019530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b335894-7974-41c8-a198-2d501b95a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:20.019886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b335894-7974-41c8-a198-2d501b95a397 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:20.020592 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b335894-7974-41c8-a198-2d501b95a397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:20.022191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b335894-7974-41c8-a198-2d501b95a397 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:20.031987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 918/1826] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:20.033414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7464a-cbe8-47d1-beed-86ca9ad92ce5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:20.033689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7464a-cbe8-47d1-beed-86ca9ad92ce5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:20.033961 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7464a-cbe8-47d1-beed-86ca9ad92ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:20.055350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-7dd7464a-cbe8-47d1-beed-86ca9ad92ce5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:20.056828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7dd7464a-cbe8-47d1-beed-86ca9ad92ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:20.060276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6671d34188e544a3946d502e1d456fbe'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:20.065240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 919/1827] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:20.066415 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7464a-cbe8-47d1-beed-86ca9ad92ce5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:20.073646 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6671d34188e544a3946d502e1d456fbe'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:20.076691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7464a-cbe8-47d1-beed-86ca9ad92ce5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:20.081545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297cc16-6274-48cc-b456-716f59512225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:20.082205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297cc16-6274-48cc-b456-716f59512225 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:20.082485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297cc16-6274-48cc-b456-716f59512225 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:20.082758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297cc16-6274-48cc-b456-716f59512225 admin admin] PATH_INFO: `/v3/projects/0cd53842d55b4b3bba7d1db8fdca3723/users/42b29d27e90147bd9f7ce2d3ba88311f/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:20.097849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297cc16-6274-48cc-b456-716f59512225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd53842d55b4b3bba7d1db8fdca3723, user_id=42b29d27e90147bd9f7ce2d3ba88311f, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:20.100546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297cc16-6274-48cc-b456-716f59512225 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:20.159457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:20.222051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6671d34188e544a3946d502e1d456fbe'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:20.223236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6671d34188e544a3946d502e1d456fbe'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:20.228836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 920/1828] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:20 2022] PUT /identity/v3/projects/0cd53842d55b4b3bba7d1db8fdca3723/users/42b29d27e90147bd9f7ce2d3ba88311f/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:20.229814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297cc16-6274-48cc-b456-716f59512225 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:20.231320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-bdf31714-e59e-49cd-8685-68a09ee1455e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6671d34188e544a3946d502e1d456fbe'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:20.231541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8297cc16-6274-48cc-b456-716f59512225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:20.238019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 909/1829] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:19 2022] DELETE /identity/v3/users/6671d34188e544a3946d502e1d456fbe => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:20.239471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15de3fc-e646-4841-9769-9f1f4987f2d0 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:20.239765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15de3fc-e646-4841-9769-9f1f4987f2d0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:20.240045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15de3fc-e646-4841-9769-9f1f4987f2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:20.281932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a15de3fc-e646-4841-9769-9f1f4987f2d0 None None] MFA Rules not processed for user `42b29d27e90147bd9f7ce2d3ba88311f`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:20.281932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a15de3fc-e646-4841-9769-9f1f4987f2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:20.298527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297cc16-6274-48cc-b456-716f59512225 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:20.357492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 910/1830] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:20.361141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ad664-39a1-4107-a71b-af99a5849aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:20.366244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ad664-39a1-4107-a71b-af99a5849aff service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:20.366244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ad664-39a1-4107-a71b-af99a5849aff service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:20.366244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ad664-39a1-4107-a71b-af99a5849aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:20.366244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-511ad664-39a1-4107-a71b-af99a5849aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:20.375486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15de3fc-e646-4841-9769-9f1f4987f2d0 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:20.377078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a15de3fc-e646-4841-9769-9f1f4987f2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:20.434510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ad664-39a1-4107-a71b-af99a5849aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:20.435962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ad664-39a1-4107-a71b-af99a5849aff service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:20.443553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15de3fc-e646-4841-9769-9f1f4987f2d0 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:20.446075 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 921/1831] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:20.449911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2042e-2065-4469-b70b-4597319ecb7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:20.450538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2042e-2065-4469-b70b-4597319ecb7a service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:20.450809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2042e-2065-4469-b70b-4597319ecb7a service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:20.451077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2042e-2065-4469-b70b-4597319ecb7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:20.460934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2042e-2065-4469-b70b-4597319ecb7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:20.462377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2042e-2065-4469-b70b-4597319ecb7a service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:20.471396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 911/1832] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:58:20.844088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ad664-39a1-4107-a71b-af99a5849aff service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:20.844088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-511ad664-39a1-4107-a71b-af99a5849aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:20.864843 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ad664-39a1-4107-a71b-af99a5849aff service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:20.870088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:20.870796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:20.871239 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:20.871662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] PATH_INFO: `/v3/projects/eb6003b54b8f4a3996a27cb7c71467df` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:20.889637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6003b54b8f4a3996a27cb7c71467df)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:20.889637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:21.034184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6003b54b8f4a3996a27cb7c71467df', 'request_id': 'req-d490bfbe-3415-4862-8002-0b1dc5a56ed1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.041924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6003b54b8f4a3996a27cb7c71467df', 'request_id': 'req-d490bfbe-3415-4862-8002-0b1dc5a56ed1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.048582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6003b54b8f4a3996a27cb7c71467df', 'request_id': 'req-d490bfbe-3415-4862-8002-0b1dc5a56ed1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.121418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2042e-2065-4469-b70b-4597319ecb7a service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:21.122988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-08c2042e-2065-4469-b70b-4597319ecb7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:21.138318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2042e-2065-4469-b70b-4597319ecb7a service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:21.159450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] The token cache is being invalidate because project eb6003b54b8f4a3996a27cb7c71467df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:21.159450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.159450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d490bfbe-3415-4862-8002-0b1dc5a56ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.163857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 922/1833] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:20 2022] DELETE /identity/v3/projects/eb6003b54b8f4a3996a27cb7c71467df => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:21.165352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca68541-17e8-4a63-919a-5ba3e1583fff None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:21.165783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca68541-17e8-4a63-919a-5ba3e1583fff None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:21.166066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca68541-17e8-4a63-919a-5ba3e1583fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:21.200228 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0ca68541-17e8-4a63-919a-5ba3e1583fff None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:21.201902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0ca68541-17e8-4a63-919a-5ba3e1583fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:21.225814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75045734-433f-4452-bc84-e47241877758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:21.226595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75045734-433f-4452-bc84-e47241877758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:21.226866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75045734-433f-4452-bc84-e47241877758 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:21.227133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75045734-433f-4452-bc84-e47241877758 admin admin] PATH_INFO: `/v3/projects/690134afbe59416e9337245e37d660b4` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:21.228269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75045734-433f-4452-bc84-e47241877758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690134afbe59416e9337245e37d660b4)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:21.230209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75045734-433f-4452-bc84-e47241877758 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:21.264146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 923/1834] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:21.265198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca68541-17e8-4a63-919a-5ba3e1583fff None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:21.266618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0ca68541-17e8-4a63-919a-5ba3e1583fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:21.280807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca68541-17e8-4a63-919a-5ba3e1583fff None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:21.287182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:21.287921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:21.288224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:21.288491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] PATH_INFO: `/v3/users/80ef36598fba48c19bb97678fdf5363f` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:21.289804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ef36598fba48c19bb97678fdf5363f)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:21.291759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:21.399893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-75045734-433f-4452-bc84-e47241877758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690134afbe59416e9337245e37d660b4', 'request_id': 'req-75045734-433f-4452-bc84-e47241877758'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.497100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-75045734-433f-4452-bc84-e47241877758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690134afbe59416e9337245e37d660b4', 'request_id': 'req-75045734-433f-4452-bc84-e47241877758'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.505185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-75045734-433f-4452-bc84-e47241877758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690134afbe59416e9337245e37d660b4', 'request_id': 'req-75045734-433f-4452-bc84-e47241877758'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.529531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-75045734-433f-4452-bc84-e47241877758 admin admin] The token cache is being invalidate because project 690134afbe59416e9337245e37d660b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:21.530055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-75045734-433f-4452-bc84-e47241877758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.531133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-75045734-433f-4452-bc84-e47241877758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.538349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 912/1835] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:21 2022] DELETE /identity/v3/projects/690134afbe59416e9337245e37d660b4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:21.538349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37374173-f8b3-4cb1-b90f-b7d373a60197 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:21.538349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37374173-f8b3-4cb1-b90f-b7d373a60197 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:21.541588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37374173-f8b3-4cb1-b90f-b7d373a60197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:21.566320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-37374173-f8b3-4cb1-b90f-b7d373a60197 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:21.569082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-37374173-f8b3-4cb1-b90f-b7d373a60197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:21.610420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ef36598fba48c19bb97678fdf5363f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.619709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ef36598fba48c19bb97678fdf5363f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.645917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 913/1836] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:21.647150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37374173-f8b3-4cb1-b90f-b7d373a60197 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:21.648721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-37374173-f8b3-4cb1-b90f-b7d373a60197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:21.661718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37374173-f8b3-4cb1-b90f-b7d373a60197 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:21.666969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:21.667753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:21.668103 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:21.668453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] PATH_INFO: `/v3/users/e3c7bad9b31d426499842dbbb2873fab` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:21.669734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c7bad9b31d426499842dbbb2873fab)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:21.671805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:21.736420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ef36598fba48c19bb97678fdf5363f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.737112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ef36598fba48c19bb97678fdf5363f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.737724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ef36598fba48c19bb97678fdf5363f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.762994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 924/1837] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:21 2022] DELETE /identity/v3/users/80ef36598fba48c19bb97678fdf5363f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:21.762994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:21.763544 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:21.837063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a55ff-a236-49e2-964c-dcc6b52b9a4a admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:21.841686 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7f916-3f18-4a87-b699-95d96046fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:21.842302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f916-3f18-4a87-b699-95d96046fb83 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:21.842578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f916-3f18-4a87-b699-95d96046fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:21.842846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f916-3f18-4a87-b699-95d96046fb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:21.843505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7f916-3f18-4a87-b699-95d96046fb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:21.843797 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7f916-3f18-4a87-b699-95d96046fb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:21.845448 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7f916-3f18-4a87-b699-95d96046fb83 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:21.873083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 925/1838] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:21.875935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34fb81-9746-4442-bdae-e5a99bd25509 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:21.876445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34fb81-9746-4442-bdae-e5a99bd25509 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:21.876956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34fb81-9746-4442-bdae-e5a99bd25509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:21.897289 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-7c34fb81-9746-4442-bdae-e5a99bd25509 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:21.898497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7c34fb81-9746-4442-bdae-e5a99bd25509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:21.906808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 926/1839] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:21.907691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34fb81-9746-4442-bdae-e5a99bd25509 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:21.917611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34fb81-9746-4442-bdae-e5a99bd25509 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:21.922959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f187c-3de8-49bd-97a2-4e3a028dde03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:21.923579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f187c-3de8-49bd-97a2-4e3a028dde03 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:21.924237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f187c-3de8-49bd-97a2-4e3a028dde03 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:21.924237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f187c-3de8-49bd-97a2-4e3a028dde03 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:21.924759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f187c-3de8-49bd-97a2-4e3a028dde03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:21.927218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f187c-3de8-49bd-97a2-4e3a028dde03 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:21.980933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c7bad9b31d426499842dbbb2873fab'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:21.995607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c7bad9b31d426499842dbbb2873fab'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:22.109686 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 927/1840] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:21 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:22.110679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f187c-3de8-49bd-97a2-4e3a028dde03 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:22.112417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a00f187c-3de8-49bd-97a2-4e3a028dde03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:22.128859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c7bad9b31d426499842dbbb2873fab'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:22.129795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c7bad9b31d426499842dbbb2873fab'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:22.141079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c7bad9b31d426499842dbbb2873fab'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:22.151417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 914/1841] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:21 2022] DELETE /identity/v3/users/e3c7bad9b31d426499842dbbb2873fab => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:22.151417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:22.151417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:22.187550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f187c-3de8-49bd-97a2-4e3a028dde03 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:22.260594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c616437-ec55-4486-9f87-3d57c7b95c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:22.261786 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c616437-ec55-4486-9f87-3d57c7b95c27 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:22.262307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c616437-ec55-4486-9f87-3d57c7b95c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:22.262596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c616437-ec55-4486-9f87-3d57c7b95c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:22.264807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4c616437-ec55-4486-9f87-3d57c7b95c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:22.274138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469397c2-82b0-4c24-98a2-817b92ebd5f0 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:22.278618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c616437-ec55-4486-9f87-3d57c7b95c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:22.279812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a330a-c513-459f-8cc8-8199ad24e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:22.280217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c616437-ec55-4486-9f87-3d57c7b95c27 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:22.281103 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a330a-c513-459f-8cc8-8199ad24e452 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:22.281386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a330a-c513-459f-8cc8-8199ad24e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:22.281741 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a330a-c513-459f-8cc8-8199ad24e452 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:22.284047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a330a-c513-459f-8cc8-8199ad24e452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:22.286541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a330a-c513-459f-8cc8-8199ad24e452 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:22.291947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 928/1842] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:22.498342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 915/1843] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:22 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:22.506727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c616437-ec55-4486-9f87-3d57c7b95c27 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:22.519708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c616437-ec55-4486-9f87-3d57c7b95c27 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:22.537906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237d7fc-b666-4d69-a832-672ca3200166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:22.538569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237d7fc-b666-4d69-a832-672ca3200166 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:22.539152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237d7fc-b666-4d69-a832-672ca3200166 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:22.539421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237d7fc-b666-4d69-a832-672ca3200166 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:22.540073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237d7fc-b666-4d69-a832-672ca3200166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:22.543171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237d7fc-b666-4d69-a832-672ca3200166 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:22.574321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a330a-c513-459f-8cc8-8199ad24e452 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:22.584899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 929/1844] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:22.588414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a330a-c513-459f-8cc8-8199ad24e452 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:22.616819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5c4c-08de-45cc-ac32-49b2caef7d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:22.618166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5c4c-08de-45cc-ac32-49b2caef7d8e admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:22.618512 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5c4c-08de-45cc-ac32-49b2caef7d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:22.618857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5c4c-08de-45cc-ac32-49b2caef7d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:22.619599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd5c4c-08de-45cc-ac32-49b2caef7d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:22.624762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd5c4c-08de-45cc-ac32-49b2caef7d8e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:22.647673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 916/1845] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:22.648665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237d7fc-b666-4d69-a832-672ca3200166 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:22.659419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237d7fc-b666-4d69-a832-672ca3200166 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:22.682097 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157cc5c-f5a2-4785-b6c6-74d24e77bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:22.682805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157cc5c-f5a2-4785-b6c6-74d24e77bad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:22.683090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157cc5c-f5a2-4785-b6c6-74d24e77bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:22.683372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157cc5c-f5a2-4785-b6c6-74d24e77bad6 admin admin] PATH_INFO: `/v3/projects/8dfa11117fbf452687faeec806f20c89/users/cb864c3ae1ea49ae921b8c6df945e1e9/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:22.723742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157cc5c-f5a2-4785-b6c6-74d24e77bad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfa11117fbf452687faeec806f20c89, user_id=cb864c3ae1ea49ae921b8c6df945e1e9, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:22.728484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157cc5c-f5a2-4785-b6c6-74d24e77bad6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:22.865670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5c4c-08de-45cc-ac32-49b2caef7d8e admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:22.873894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 930/1846] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:22 2022] PUT /identity/v3/projects/8dfa11117fbf452687faeec806f20c89/users/cb864c3ae1ea49ae921b8c6df945e1e9/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:22.874285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7cfd5c4c-08de-45cc-ac32-49b2caef7d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:22.877951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c93d43-bbe3-4b23-aa88-b1aab713a56b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:22.879312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c93d43-bbe3-4b23-aa88-b1aab713a56b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:22.879312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c93d43-bbe3-4b23-aa88-b1aab713a56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:22.889648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5c4c-08de-45cc-ac32-49b2caef7d8e admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:22.917042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-38c93d43-bbe3-4b23-aa88-b1aab713a56b None None] MFA Rules not processed for user `cb864c3ae1ea49ae921b8c6df945e1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:22.918357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-38c93d43-bbe3-4b23-aa88-b1aab713a56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:22.973860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:22.973860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:22.973860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:22.973860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] PATH_INFO: `/v3/projects/0f554efce1bf46b898be56a4fe0b087b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:22.976164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f554efce1bf46b898be56a4fe0b087b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:22.978996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:23.013334 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 931/1847] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:23.014227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c93d43-bbe3-4b23-aa88-b1aab713a56b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:23.015747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-38c93d43-bbe3-4b23-aa88-b1aab713a56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:23.029730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c93d43-bbe3-4b23-aa88-b1aab713a56b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:23.034334 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:23.034983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:23.035272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:23.035554 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] PATH_INFO: `/v3/projects/117071f4b33f4dcdb95d1290f56f067c` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:23.036703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=117071f4b33f4dcdb95d1290f56f067c)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:23.038607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:23.197102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f554efce1bf46b898be56a4fe0b087b', 'request_id': 'req-47b2548b-bd91-4a56-b03f-aefa1359d109'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:23.200322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117071f4b33f4dcdb95d1290f56f067c', 'request_id': 'req-1c99d7d6-a322-4d8a-b00b-255617f70067'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:23.207486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117071f4b33f4dcdb95d1290f56f067c', 'request_id': 'req-1c99d7d6-a322-4d8a-b00b-255617f70067'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:23.214724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117071f4b33f4dcdb95d1290f56f067c', 'request_id': 'req-1c99d7d6-a322-4d8a-b00b-255617f70067'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:23.399544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f554efce1bf46b898be56a4fe0b087b', 'request_id': 'req-47b2548b-bd91-4a56-b03f-aefa1359d109'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:23.407448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f554efce1bf46b898be56a4fe0b087b', 'request_id': 'req-47b2548b-bd91-4a56-b03f-aefa1359d109'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:23.420663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] The token cache is being invalidate because project 0f554efce1bf46b898be56a4fe0b087b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:23.420956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:23.422345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:23.423899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 917/1848] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:22 2022] DELETE /identity/v3/projects/0f554efce1bf46b898be56a4fe0b087b => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:23.427800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:23.429547 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:23.489242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2548b-bd91-4a56-b03f-aefa1359d109 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:23.538580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42452a8d-83a2-435d-bf9c-3305950e3704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:23.540223 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42452a8d-83a2-435d-bf9c-3305950e3704 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:23.540541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42452a8d-83a2-435d-bf9c-3305950e3704 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:23.540817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42452a8d-83a2-435d-bf9c-3305950e3704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:23.542557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-42452a8d-83a2-435d-bf9c-3305950e3704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:23.559206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] The token cache is being invalidate because project 117071f4b33f4dcdb95d1290f56f067c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:23.559776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:23.561300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1c99d7d6-a322-4d8a-b00b-255617f70067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:23.563131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 932/1849] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:23 2022] DELETE /identity/v3/projects/117071f4b33f4dcdb95d1290f56f067c => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:23.564468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b3958-dd21-43ed-b9e4-086ba3086209 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:23.564960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b3958-dd21-43ed-b9e4-086ba3086209 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:23.565321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b3958-dd21-43ed-b9e4-086ba3086209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:23.585414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-685b3958-dd21-43ed-b9e4-086ba3086209 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:23.586699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-685b3958-dd21-43ed-b9e4-086ba3086209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:23.604785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42452a8d-83a2-435d-bf9c-3305950e3704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:23.606303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42452a8d-83a2-435d-bf9c-3305950e3704 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:23.616161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 918/1850] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:23.616855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42452a8d-83a2-435d-bf9c-3305950e3704 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:23.618350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-42452a8d-83a2-435d-bf9c-3305950e3704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:23.654814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 933/1851] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:23.655784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b3958-dd21-43ed-b9e4-086ba3086209 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:23.657150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-685b3958-dd21-43ed-b9e4-086ba3086209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:23.669634 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b3958-dd21-43ed-b9e4-086ba3086209 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:23.674590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:23.675890 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:23.676215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:23.676493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] PATH_INFO: `/v3/users/cb864c3ae1ea49ae921b8c6df945e1e9` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:23.678010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb864c3ae1ea49ae921b8c6df945e1e9)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:23.679949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:23.690008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42452a8d-83a2-435d-bf9c-3305950e3704 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:23.695079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:23.695743 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:23.696022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:23.696297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] PATH_INFO: `/v3/users/fb2ef954867547f995d333824d146a9d` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:23.697532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2ef954867547f995d333824d146a9d)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:23.699466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:24.030426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb864c3ae1ea49ae921b8c6df945e1e9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:24.038047 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb864c3ae1ea49ae921b8c6df945e1e9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:24.080105 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:24.095425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2ef954867547f995d333824d146a9d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:24.109330 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2ef954867547f995d333824d146a9d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:24.171040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb864c3ae1ea49ae921b8c6df945e1e9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:24.171750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb864c3ae1ea49ae921b8c6df945e1e9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:24.172461 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-055a6a4c-ab37-4d9d-943a-344230824dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb864c3ae1ea49ae921b8c6df945e1e9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:24.191691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 934/1852] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:23 2022] DELETE /identity/v3/users/cb864c3ae1ea49ae921b8c6df945e1e9 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:24.193101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4588982-ced1-4785-9580-e0d766dfb939 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:24.193392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4588982-ced1-4785-9580-e0d766dfb939 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:24.193864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4588982-ced1-4785-9580-e0d766dfb939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:24.214750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e4588982-ced1-4785-9580-e0d766dfb939 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:24.215950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e4588982-ced1-4785-9580-e0d766dfb939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:24.276694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 935/1853] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:24.280310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98002b70-7457-48ee-8dcb-f795ddd44fe5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:24.280310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98002b70-7457-48ee-8dcb-f795ddd44fe5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:24.280310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98002b70-7457-48ee-8dcb-f795ddd44fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:24.297579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-98002b70-7457-48ee-8dcb-f795ddd44fe5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:24.298814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-98002b70-7457-48ee-8dcb-f795ddd44fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:24.306994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 936/1854] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:24.308661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98002b70-7457-48ee-8dcb-f795ddd44fe5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:24.320614 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98002b70-7457-48ee-8dcb-f795ddd44fe5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:24.324559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2ef954867547f995d333824d146a9d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:24.325285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2ef954867547f995d333824d146a9d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:24.325396 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd2b4a-2a5a-45d1-b3e8-cc660fdc03d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:24.325974 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd2b4a-2a5a-45d1-b3e8-cc660fdc03d3 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:24.326260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd2b4a-2a5a-45d1-b3e8-cc660fdc03d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:24.326531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd2b4a-2a5a-45d1-b3e8-cc660fdc03d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:24.327353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd2b4a-2a5a-45d1-b3e8-cc660fdc03d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:24.327534 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd2b4a-2a5a-45d1-b3e8-cc660fdc03d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:24.329253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd2b4a-2a5a-45d1-b3e8-cc660fdc03d3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:24.333859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2ef954867547f995d333824d146a9d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:24.339878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 919/1855] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:23 2022] DELETE /identity/v3/users/fb2ef954867547f995d333824d146a9d => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:24.342057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 937/1856] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:24.346381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd2b4a-2a5a-45d1-b3e8-cc660fdc03d3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:24.348193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2bdd2b4a-2a5a-45d1-b3e8-cc660fdc03d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:24.350044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:24.352162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:24.361326 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd2b4a-2a5a-45d1-b3e8-cc660fdc03d3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:24.415778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66906e2c-3421-4ec9-b3bb-494e854634b9 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:24.419926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892732e-b4d5-4bb9-a9a4-0de07816f3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:24.420764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892732e-b4d5-4bb9-a9a4-0de07816f3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:24.421046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892732e-b4d5-4bb9-a9a4-0de07816f3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:24.421320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892732e-b4d5-4bb9-a9a4-0de07816f3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:24.423270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b892732e-b4d5-4bb9-a9a4-0de07816f3f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:24.427784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94835472-c7d7-459b-8703-fbf14968ca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:24.428443 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835472-c7d7-459b-8703-fbf14968ca28 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:24.429610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835472-c7d7-459b-8703-fbf14968ca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:24.429889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835472-c7d7-459b-8703-fbf14968ca28 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:24.431090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94835472-c7d7-459b-8703-fbf14968ca28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:24.433067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94835472-c7d7-459b-8703-fbf14968ca28 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:24.437504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892732e-b4d5-4bb9-a9a4-0de07816f3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:24.438967 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892732e-b4d5-4bb9-a9a4-0de07816f3f2 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:24.451924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 920/1857] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:24.653147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 938/1858] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:24 2022] POST /identity/v3/projects => generated 391 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:24.654739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892732e-b4d5-4bb9-a9a4-0de07816f3f2 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:24.665102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892732e-b4d5-4bb9-a9a4-0de07816f3f2 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:24.735140 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417211aa-503b-445a-88d4-4e4798f4b876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:24.735757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417211aa-503b-445a-88d4-4e4798f4b876 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:24.736034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417211aa-503b-445a-88d4-4e4798f4b876 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:24.736305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417211aa-503b-445a-88d4-4e4798f4b876 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:24.736993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417211aa-503b-445a-88d4-4e4798f4b876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:24.739616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417211aa-503b-445a-88d4-4e4798f4b876 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:24.903524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 921/1859] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:24 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:24.907728 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94835472-c7d7-459b-8703-fbf14968ca28 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:24.917980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94835472-c7d7-459b-8703-fbf14968ca28 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:24.922693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e616c-a518-4e5e-b815-e91d8c3abeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:24.926468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e616c-a518-4e5e-b815-e91d8c3abeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:24.926468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e616c-a518-4e5e-b815-e91d8c3abeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:24.926468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e616c-a518-4e5e-b815-e91d8c3abeb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:24.926468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e616c-a518-4e5e-b815-e91d8c3abeb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:24.926773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e616c-a518-4e5e-b815-e91d8c3abeb3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:24.937419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 939/1860] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:24.942125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417211aa-503b-445a-88d4-4e4798f4b876 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:24.959503 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e616c-a518-4e5e-b815-e91d8c3abeb3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:24.961215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417211aa-503b-445a-88d4-4e4798f4b876 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:24.967447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-078e616c-a518-4e5e-b815-e91d8c3abeb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:24.971561 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b93eb5-89a6-44b7-8351-ffe5c11952e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:24.972426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93eb5-89a6-44b7-8351-ffe5c11952e3 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:24.972805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93eb5-89a6-44b7-8351-ffe5c11952e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:24.973145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93eb5-89a6-44b7-8351-ffe5c11952e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:24.973910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b93eb5-89a6-44b7-8351-ffe5c11952e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:24.975595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b93eb5-89a6-44b7-8351-ffe5c11952e3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:24.988862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e616c-a518-4e5e-b815-e91d8c3abeb3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:24.990047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 922/1861] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:24.991028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b93eb5-89a6-44b7-8351-ffe5c11952e3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:25.011250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:25.011250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.011250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.011250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] PATH_INFO: `/v3/projects/3f74571b681b454cbd8c2e7166a20aa9` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.012046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f74571b681b454cbd8c2e7166a20aa9)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:25.012150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b93eb5-89a6-44b7-8351-ffe5c11952e3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:25.012238 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:25.012761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29505a5a-f752-48b5-99c1-742715fd015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:25.013586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29505a5a-f752-48b5-99c1-742715fd015d admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.014090 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29505a5a-f752-48b5-99c1-742715fd015d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.014375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29505a5a-f752-48b5-99c1-742715fd015d admin admin] PATH_INFO: `/v3/projects/bfc33c5f2ea34ecc8571c01ae49a8d65/users/4cac1aacdc2a432a95a25df248088739/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.033653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29505a5a-f752-48b5-99c1-742715fd015d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc33c5f2ea34ecc8571c01ae49a8d65, user_id=4cac1aacdc2a432a95a25df248088739, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:25.037628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29505a5a-f752-48b5-99c1-742715fd015d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:25.143192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 923/1862] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:24 2022] PUT /identity/v3/projects/bfc33c5f2ea34ecc8571c01ae49a8d65/users/4cac1aacdc2a432a95a25df248088739/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:25.144163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29505a5a-f752-48b5-99c1-742715fd015d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:25.146001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-29505a5a-f752-48b5-99c1-742715fd015d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:25.156751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f74571b681b454cbd8c2e7166a20aa9', 'request_id': 'req-036d6114-b733-4552-ba3e-b3d24cf4e71c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:25.163765 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f74571b681b454cbd8c2e7166a20aa9', 'request_id': 'req-036d6114-b733-4552-ba3e-b3d24cf4e71c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:25.170788 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f74571b681b454cbd8c2e7166a20aa9', 'request_id': 'req-036d6114-b733-4552-ba3e-b3d24cf4e71c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:25.221248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29505a5a-f752-48b5-99c1-742715fd015d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:25.280014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:25.280753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.281041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.281315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] PATH_INFO: `/v3/projects/8dfa11117fbf452687faeec806f20c89` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.282444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfa11117fbf452687faeec806f20c89)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:25.284346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:25.370910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] The token cache is being invalidate because project 3f74571b681b454cbd8c2e7166a20aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:25.371124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:25.371721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-036d6114-b733-4552-ba3e-b3d24cf4e71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:25.373706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 940/1863] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:24 2022] DELETE /identity/v3/projects/3f74571b681b454cbd8c2e7166a20aa9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:25.375333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daf02b-1923-4c62-a0d7-11e59f9bbae3 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.375501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daf02b-1923-4c62-a0d7-11e59f9bbae3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.375782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daf02b-1923-4c62-a0d7-11e59f9bbae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.409379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b3daf02b-1923-4c62-a0d7-11e59f9bbae3 None None] MFA Rules not processed for user `4cac1aacdc2a432a95a25df248088739`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:25.409379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b3daf02b-1923-4c62-a0d7-11e59f9bbae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:25.413551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfa11117fbf452687faeec806f20c89', 'request_id': 'req-6ed55173-5e72-45ed-85f3-318957d365c1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:25.435390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:25.484888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 941/1864] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:25.486413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c268e-005f-40ec-b532-6296348fbc76 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.486704 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c268e-005f-40ec-b532-6296348fbc76 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.486979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c268e-005f-40ec-b532-6296348fbc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.506429 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b69c268e-005f-40ec-b532-6296348fbc76 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:25.507649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b69c268e-005f-40ec-b532-6296348fbc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:25.530484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfa11117fbf452687faeec806f20c89', 'request_id': 'req-6ed55173-5e72-45ed-85f3-318957d365c1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:25.538338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfa11117fbf452687faeec806f20c89', 'request_id': 'req-6ed55173-5e72-45ed-85f3-318957d365c1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:25.549162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] The token cache is being invalidate because project 8dfa11117fbf452687faeec806f20c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:25.549458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:25.550151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:25.551702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 924/1865] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:25 2022] DELETE /identity/v3/projects/8dfa11117fbf452687faeec806f20c89 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:25.552800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:25.554146 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:25.570177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 942/1866] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:25.571817 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bafa-df30-4d34-9062-3055d708c64c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.572222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bafa-df30-4d34-9062-3055d708c64c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.572636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bafa-df30-4d34-9062-3055d708c64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.592033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-51c7bafa-df30-4d34-9062-3055d708c64c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:25.593262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-51c7bafa-df30-4d34-9062-3055d708c64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:25.602283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 943/1867] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:25.603565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79ecf2-734a-4b4d-b762-4e7eec45402f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.603844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79ecf2-734a-4b4d-b762-4e7eec45402f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.604111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79ecf2-734a-4b4d-b762-4e7eec45402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.620149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed55173-5e72-45ed-85f3-318957d365c1 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:25.629097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbee16-4645-471f-af55-56cbf46215c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:25.629097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbee16-4645-471f-af55-56cbf46215c1 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.629097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbee16-4645-471f-af55-56cbf46215c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.629097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbee16-4645-471f-af55-56cbf46215c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.629506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbee16-4645-471f-af55-56cbf46215c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:25.629606 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-cd79ecf2-734a-4b4d-b762-4e7eec45402f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:25.629705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbee16-4645-471f-af55-56cbf46215c1 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:25.630287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-cd79ecf2-734a-4b4d-b762-4e7eec45402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:25.638663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 944/1868] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:25.640006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517d18d-8b26-456f-b8f5-a2e37b89c58d None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.640299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517d18d-8b26-456f-b8f5-a2e37b89c58d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.640588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517d18d-8b26-456f-b8f5-a2e37b89c58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.660966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0517d18d-8b26-456f-b8f5-a2e37b89c58d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:25.662145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0517d18d-8b26-456f-b8f5-a2e37b89c58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:25.670014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 945/1869] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:25.670778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517d18d-8b26-456f-b8f5-a2e37b89c58d None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:25.680124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517d18d-8b26-456f-b8f5-a2e37b89c58d None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:25.684976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cbd33-0c7f-4bb6-8df3-9243d3a1b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:25.685679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cbd33-0c7f-4bb6-8df3-9243d3a1b103 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.685794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cbd33-0c7f-4bb6-8df3-9243d3a1b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.686066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cbd33-0c7f-4bb6-8df3-9243d3a1b103 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.686795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cbd33-0c7f-4bb6-8df3-9243d3a1b103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:25.687094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cbd33-0c7f-4bb6-8df3-9243d3a1b103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:25.688815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cbd33-0c7f-4bb6-8df3-9243d3a1b103 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:25.703513 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 946/1870] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:25.703513 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cbd33-0c7f-4bb6-8df3-9243d3a1b103 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:25.713842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cbd33-0c7f-4bb6-8df3-9243d3a1b103 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:25.718763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f9a46-80be-46dd-9c34-6df17d5b8cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:25.719456 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f9a46-80be-46dd-9c34-6df17d5b8cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.719735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f9a46-80be-46dd-9c34-6df17d5b8cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.720007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f9a46-80be-46dd-9c34-6df17d5b8cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.720688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f9a46-80be-46dd-9c34-6df17d5b8cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:25.720986 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f9a46-80be-46dd-9c34-6df17d5b8cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:25.723141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f9a46-80be-46dd-9c34-6df17d5b8cf0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:25.735702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 947/1871] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:25.736721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f9a46-80be-46dd-9c34-6df17d5b8cf0 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:25.746704 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f9a46-80be-46dd-9c34-6df17d5b8cf0 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:25.751584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12a437-6a62-468b-9470-d5ff9a243a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:25.752181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12a437-6a62-468b-9470-d5ff9a243a4b admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.752458 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12a437-6a62-468b-9470-d5ff9a243a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.752752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12a437-6a62-468b-9470-d5ff9a243a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.753376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12a437-6a62-468b-9470-d5ff9a243a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:25.755261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12a437-6a62-468b-9470-d5ff9a243a4b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:25.781039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 925/1872] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:25 2022] POST /identity/v3/projects => generated 393 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:25.781039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbee16-4645-471f-af55-56cbf46215c1 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:25.840885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbee16-4645-471f-af55-56cbf46215c1 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:25.845705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6faa7-2ce1-46bf-ac77-2fb2e40da78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:25.846316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6faa7-2ce1-46bf-ac77-2fb2e40da78f admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:25.846618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6faa7-2ce1-46bf-ac77-2fb2e40da78f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:25.846887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6faa7-2ce1-46bf-ac77-2fb2e40da78f admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:25.847542 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6faa7-2ce1-46bf-ac77-2fb2e40da78f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:25.849622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6faa7-2ce1-46bf-ac77-2fb2e40da78f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:25.917801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 948/1873] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:25 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:25.917801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12a437-6a62-468b-9470-d5ff9a243a4b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:25.949340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 926/1874] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:25 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:25.950458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6faa7-2ce1-46bf-ac77-2fb2e40da78f admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.008501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12a437-6a62-468b-9470-d5ff9a243a4b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.026971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6faa7-2ce1-46bf-ac77-2fb2e40da78f admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.031829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8a32a-f12e-411b-ae18-6a8b702fdf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.032445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8a32a-f12e-411b-ae18-6a8b702fdf52 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.033123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8a32a-f12e-411b-ae18-6a8b702fdf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.033123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8a32a-f12e-411b-ae18-6a8b702fdf52 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.033691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8a32a-f12e-411b-ae18-6a8b702fdf52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.035716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8a32a-f12e-411b-ae18-6a8b702fdf52 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.068974 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61a45f-46af-485c-9774-c4be46a133ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.069591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61a45f-46af-485c-9774-c4be46a133ab admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.069870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61a45f-46af-485c-9774-c4be46a133ab admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.070140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61a45f-46af-485c-9774-c4be46a133ab admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.070764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61a45f-46af-485c-9774-c4be46a133ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.072721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61a45f-46af-485c-9774-c4be46a133ab admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.181822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 949/1875] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:25 2022] POST /identity/v3/users => generated 303 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:26.182738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61a45f-46af-485c-9774-c4be46a133ab admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.189536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 927/1876] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:25 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:26.189536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8a32a-f12e-411b-ae18-6a8b702fdf52 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.195525 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61a45f-46af-485c-9774-c4be46a133ab admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.200932 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc75483-1db0-41fb-977b-2b5ff2ca2b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.201101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8a32a-f12e-411b-ae18-6a8b702fdf52 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.201562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc75483-1db0-41fb-977b-2b5ff2ca2b45 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.201845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc75483-1db0-41fb-977b-2b5ff2ca2b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.202123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc75483-1db0-41fb-977b-2b5ff2ca2b45 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.202755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc75483-1db0-41fb-977b-2b5ff2ca2b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.204929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc75483-1db0-41fb-977b-2b5ff2ca2b45 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.207101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb45926-8616-485f-b7da-c2ee059e2050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.207723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb45926-8616-485f-b7da-c2ee059e2050 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.207999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb45926-8616-485f-b7da-c2ee059e2050 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.208269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb45926-8616-485f-b7da-c2ee059e2050 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.210184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb45926-8616-485f-b7da-c2ee059e2050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.212162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb45926-8616-485f-b7da-c2ee059e2050 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.225744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 928/1877] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:26.225744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb45926-8616-485f-b7da-c2ee059e2050 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.241271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb45926-8616-485f-b7da-c2ee059e2050 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.246974 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ae366-28cb-4325-8746-9370751f0651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.247592 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ae366-28cb-4325-8746-9370751f0651 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.247874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ae366-28cb-4325-8746-9370751f0651 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.248153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ae366-28cb-4325-8746-9370751f0651 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.248836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ae366-28cb-4325-8746-9370751f0651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.250442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ae366-28cb-4325-8746-9370751f0651 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.265800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 929/1878] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:26.265800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ae366-28cb-4325-8746-9370751f0651 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.273852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ae366-28cb-4325-8746-9370751f0651 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.279675 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaebfb7-1d9a-4a69-9e0d-359189e67f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.280351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaebfb7-1d9a-4a69-9e0d-359189e67f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.280670 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaebfb7-1d9a-4a69-9e0d-359189e67f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.280947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaebfb7-1d9a-4a69-9e0d-359189e67f86 admin admin] PATH_INFO: `/v3/projects/f54d1aece4694847ba2944fff3f9109d/users/6f5da2d9fb5142f78e75fb69b3e534d3/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.298230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaebfb7-1d9a-4a69-9e0d-359189e67f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54d1aece4694847ba2944fff3f9109d, user_id=6f5da2d9fb5142f78e75fb69b3e534d3, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.305342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaebfb7-1d9a-4a69-9e0d-359189e67f86 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.370462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 950/1879] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:26 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:26.371851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc75483-1db0-41fb-977b-2b5ff2ca2b45 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.384411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc75483-1db0-41fb-977b-2b5ff2ca2b45 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.390948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a011-0562-497f-a0f0-ad1b108d284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.391663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a011-0562-497f-a0f0-ad1b108d284c admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.391903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a011-0562-497f-a0f0-ad1b108d284c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.392163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a011-0562-497f-a0f0-ad1b108d284c admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.398357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394a011-0562-497f-a0f0-ad1b108d284c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.400020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394a011-0562-497f-a0f0-ad1b108d284c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.408346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 930/1880] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:26 2022] PUT /identity/v3/projects/f54d1aece4694847ba2944fff3f9109d/users/6f5da2d9fb5142f78e75fb69b3e534d3/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:26.408346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaebfb7-1d9a-4a69-9e0d-359189e67f86 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.414974 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 951/1881] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:26.414974 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a011-0562-497f-a0f0-ad1b108d284c admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.425571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a011-0562-497f-a0f0-ad1b108d284c admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.477360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaebfb7-1d9a-4a69-9e0d-359189e67f86 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.484098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412fe2d-1b7a-4351-8569-226f5635d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.484792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412fe2d-1b7a-4351-8569-226f5635d97a admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.485200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412fe2d-1b7a-4351-8569-226f5635d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.485476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412fe2d-1b7a-4351-8569-226f5635d97a admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.486306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412fe2d-1b7a-4351-8569-226f5635d97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.489261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412fe2d-1b7a-4351-8569-226f5635d97a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.490181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4ee7-9552-4dd2-bab3-6d304184bc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.490806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4ee7-9552-4dd2-bab3-6d304184bc76 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.491119 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4ee7-9552-4dd2-bab3-6d304184bc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.491397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce4ee7-9552-4dd2-bab3-6d304184bc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.492107 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4ee7-9552-4dd2-bab3-6d304184bc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.493888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce4ee7-9552-4dd2-bab3-6d304184bc76 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.501836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 931/1882] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:26.502641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412fe2d-1b7a-4351-8569-226f5635d97a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.508358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 952/1883] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:26.509317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4ee7-9552-4dd2-bab3-6d304184bc76 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.519716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce4ee7-9552-4dd2-bab3-6d304184bc76 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.521018 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412fe2d-1b7a-4351-8569-226f5635d97a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.525862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7d747-c4b7-459d-8dd9-5c2c008c2433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.526004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd6dd4-9f6e-4cb3-b2d9-0bebac050d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.526482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7d747-c4b7-459d-8dd9-5c2c008c2433 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.526588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd6dd4-9f6e-4cb3-b2d9-0bebac050d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.526799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7d747-c4b7-459d-8dd9-5c2c008c2433 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.526918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd6dd4-9f6e-4cb3-b2d9-0bebac050d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.527069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7d747-c4b7-459d-8dd9-5c2c008c2433 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.527164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd6dd4-9f6e-4cb3-b2d9-0bebac050d26 admin admin] PATH_INFO: `/v3/projects/e5028c1f4f194ed6988d94566ebafd70/users/f825c3b2f16d42f6b9c725096117b278/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.528188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7d747-c4b7-459d-8dd9-5c2c008c2433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.529413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7d747-c4b7-459d-8dd9-5c2c008c2433 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.545068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd6dd4-9f6e-4cb3-b2d9-0bebac050d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5028c1f4f194ed6988d94566ebafd70, user_id=f825c3b2f16d42f6b9c725096117b278, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.549250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 953/1884] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:26.549250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7d747-c4b7-459d-8dd9-5c2c008c2433 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.549433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd6dd4-9f6e-4cb3-b2d9-0bebac050d26 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.562288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7d747-c4b7-459d-8dd9-5c2c008c2433 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.567247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a3557-0b8a-43b6-a8b8-5406fe085da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.567916 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a3557-0b8a-43b6-a8b8-5406fe085da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.568201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a3557-0b8a-43b6-a8b8-5406fe085da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.568478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a3557-0b8a-43b6-a8b8-5406fe085da6 admin admin] PATH_INFO: `/v3/projects/f54d1aece4694847ba2944fff3f9109d/users/6f5da2d9fb5142f78e75fb69b3e534d3/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.570482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a3557-0b8a-43b6-a8b8-5406fe085da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54d1aece4694847ba2944fff3f9109d, user_id=6f5da2d9fb5142f78e75fb69b3e534d3, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.573186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a3557-0b8a-43b6-a8b8-5406fe085da6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.584529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 954/1885] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:26 2022] PUT /identity/v3/projects/f54d1aece4694847ba2944fff3f9109d/users/6f5da2d9fb5142f78e75fb69b3e534d3/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:26.585326 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a3557-0b8a-43b6-a8b8-5406fe085da6 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.652469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a3557-0b8a-43b6-a8b8-5406fe085da6 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:26.658497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36a4b9-9d5d-432e-8e12-7c2d659cc7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:26.659235 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36a4b9-9d5d-432e-8e12-7c2d659cc7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.660033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36a4b9-9d5d-432e-8e12-7c2d659cc7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.660312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36a4b9-9d5d-432e-8e12-7c2d659cc7b2 admin admin] PATH_INFO: `/v3/projects/567f5135c9884f4a81b8d669ae14266f/users/fc6a30e136da43ac92dabccf1f4937af/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.675833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36a4b9-9d5d-432e-8e12-7c2d659cc7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567f5135c9884f4a81b8d669ae14266f, user_id=fc6a30e136da43ac92dabccf1f4937af, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:26.678896 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36a4b9-9d5d-432e-8e12-7c2d659cc7b2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:26.719871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 932/1886] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:26 2022] PUT /identity/v3/projects/e5028c1f4f194ed6988d94566ebafd70/users/f825c3b2f16d42f6b9c725096117b278/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:26.721245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60a729-61aa-4338-a696-52c7e086e3f2 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.721526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60a729-61aa-4338-a696-52c7e086e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.722528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60a729-61aa-4338-a696-52c7e086e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.752084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7c60a729-61aa-4338-a696-52c7e086e3f2 None None] MFA Rules not processed for user `6f5da2d9fb5142f78e75fb69b3e534d3`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:26.755326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7c60a729-61aa-4338-a696-52c7e086e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:26.827561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 955/1887] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:26 2022] PUT /identity/v3/projects/567f5135c9884f4a81b8d669ae14266f/users/fc6a30e136da43ac92dabccf1f4937af/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:26.827561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb807704-cb7f-4ad3-b6b3-0774fcc1048b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.827561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb807704-cb7f-4ad3-b6b3-0774fcc1048b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.827561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb807704-cb7f-4ad3-b6b3-0774fcc1048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.836881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 933/1888] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:26.836881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e522c-58f6-40c2-8f6d-c7c837a5eed7 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:26.836881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e522c-58f6-40c2-8f6d-c7c837a5eed7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:26.836881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e522c-58f6-40c2-8f6d-c7c837a5eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:26.849969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-bb807704-cb7f-4ad3-b6b3-0774fcc1048b None None] MFA Rules not processed for user `f825c3b2f16d42f6b9c725096117b278`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:26.851920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-bb807704-cb7f-4ad3-b6b3-0774fcc1048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:26.877504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c32e522c-58f6-40c2-8f6d-c7c837a5eed7 None None] MFA Rules not processed for user `fc6a30e136da43ac92dabccf1f4937af`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:26.879399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c32e522c-58f6-40c2-8f6d-c7c837a5eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:26.939617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 956/1889] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:26.939973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb807704-cb7f-4ad3-b6b3-0774fcc1048b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:26.941404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-bb807704-cb7f-4ad3-b6b3-0774fcc1048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:26.952364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 934/1890] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:26.953359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e522c-58f6-40c2-8f6d-c7c837a5eed7 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:27.005226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb807704-cb7f-4ad3-b6b3-0774fcc1048b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:27.009068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade74570-5d78-4454-bb96-267a3b35deb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:27.009577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74570-5d78-4454-bb96-267a3b35deb4 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:27.009858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74570-5d78-4454-bb96-267a3b35deb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:27.010129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74570-5d78-4454-bb96-267a3b35deb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:27.028396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e522c-58f6-40c2-8f6d-c7c837a5eed7 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:27.032981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb2790-312e-48ae-8c86-7b162ce0b7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:27.033591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2790-312e-48ae-8c86-7b162ce0b7cf admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:27.033865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2790-312e-48ae-8c86-7b162ce0b7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:27.034132 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2790-312e-48ae-8c86-7b162ce0b7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:27.035644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb2790-312e-48ae-8c86-7b162ce0b7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:27.037442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb2790-312e-48ae-8c86-7b162ce0b7cf admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:27.083964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade74570-5d78-4454-bb96-267a3b35deb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:27.085934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade74570-5d78-4454-bb96-267a3b35deb4 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:27.096731 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:27.098558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 957/1891] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:26 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:27.099603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade74570-5d78-4454-bb96-267a3b35deb4 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:27.100995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ade74570-5d78-4454-bb96-267a3b35deb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:27.114562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade74570-5d78-4454-bb96-267a3b35deb4 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:27.119069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e816f6-4f2f-46f8-a2d1-436934466fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:27.119888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e816f6-4f2f-46f8-a2d1-436934466fca service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:27.120758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e816f6-4f2f-46f8-a2d1-436934466fca service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:27.123147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e816f6-4f2f-46f8-a2d1-436934466fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:27.130788 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e816f6-4f2f-46f8-a2d1-436934466fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:27.132344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e816f6-4f2f-46f8-a2d1-436934466fca service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:27.144816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 958/1892] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:27.157984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e816f6-4f2f-46f8-a2d1-436934466fca service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:27.164088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e816f6-4f2f-46f8-a2d1-436934466fca service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:27.172492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412e3eb-2570-4612-9cc9-6368bd57de01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:27.173097 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412e3eb-2570-4612-9cc9-6368bd57de01 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:27.173401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412e3eb-2570-4612-9cc9-6368bd57de01 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:27.173671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412e3eb-2570-4612-9cc9-6368bd57de01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:27.175754 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f412e3eb-2570-4612-9cc9-6368bd57de01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:27.195904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 935/1893] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:26 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:27.197193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb2790-312e-48ae-8c86-7b162ce0b7cf admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:27.250732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412e3eb-2570-4612-9cc9-6368bd57de01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:27.252446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412e3eb-2570-4612-9cc9-6368bd57de01 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:27.262465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 959/1894] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:27.263384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412e3eb-2570-4612-9cc9-6368bd57de01 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:27.275785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb2790-312e-48ae-8c86-7b162ce0b7cf admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:27.277902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412e3eb-2570-4612-9cc9-6368bd57de01 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:27.282425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:27.283059 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:27.283343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:27.283452 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442f93f-be06-4121-b71e-47608fb58153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:27.284026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] PATH_INFO: `/v3/users/fc6a30e136da43ac92dabccf1f4937af` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:27.284279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442f93f-be06-4121-b71e-47608fb58153 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:27.285288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442f93f-be06-4121-b71e-47608fb58153 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:27.285651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442f93f-be06-4121-b71e-47608fb58153 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:27.286066 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6a30e136da43ac92dabccf1f4937af)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:27.286454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442f93f-be06-4121-b71e-47608fb58153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:27.288402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:27.288635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442f93f-be06-4121-b71e-47608fb58153 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:27.457099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 960/1895] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:27 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:27.469702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442f93f-be06-4121-b71e-47608fb58153 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:27.480282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442f93f-be06-4121-b71e-47608fb58153 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:27.485019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3442b-5900-4e26-b495-340e91394f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:27.485622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3442b-5900-4e26-b495-340e91394f1f admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:27.485902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3442b-5900-4e26-b495-340e91394f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:27.486194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3442b-5900-4e26-b495-340e91394f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:27.486815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3442b-5900-4e26-b495-340e91394f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:27.488456 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3442b-5900-4e26-b495-340e91394f1f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:27.500204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 961/1896] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:58:27.510751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3442b-5900-4e26-b495-340e91394f1f admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:27.521464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3442b-5900-4e26-b495-340e91394f1f admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:27.526136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b69cb-99ec-461f-9e23-92b973ebfab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:27.526780 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b69cb-99ec-461f-9e23-92b973ebfab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:27.527088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b69cb-99ec-461f-9e23-92b973ebfab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:27.527366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b69cb-99ec-461f-9e23-92b973ebfab4 admin admin] PATH_INFO: `/v3/projects/bc6137ea737d48bea2b6d2658340c89c/users/c6a143de00994b4ea8dbd231d0b828cc/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:27.542163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b69cb-99ec-461f-9e23-92b973ebfab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6137ea737d48bea2b6d2658340c89c, user_id=c6a143de00994b4ea8dbd231d0b828cc, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:27.544863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b69cb-99ec-461f-9e23-92b973ebfab4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:28.061708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6a30e136da43ac92dabccf1f4937af'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:28.062787 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 962/1897] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:27 2022] PUT /identity/v3/projects/bc6137ea737d48bea2b6d2658340c89c/users/c6a143de00994b4ea8dbd231d0b828cc/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:28.062787 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b69cb-99ec-461f-9e23-92b973ebfab4 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:28.063258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6a30e136da43ac92dabccf1f4937af'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:28.099188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b69cb-99ec-461f-9e23-92b973ebfab4 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:28.103928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f1fa7-1eae-4f7d-8cfe-c05adce87743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:28.104664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1fa7-1eae-4f7d-8cfe-c05adce87743 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:28.104946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1fa7-1eae-4f7d-8cfe-c05adce87743 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:28.105218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1fa7-1eae-4f7d-8cfe-c05adce87743 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:28.105883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f1fa7-1eae-4f7d-8cfe-c05adce87743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:28.107494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f1fa7-1eae-4f7d-8cfe-c05adce87743 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:28.118459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 963/1898] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:28.127708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f1fa7-1eae-4f7d-8cfe-c05adce87743 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:28.137894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f1fa7-1eae-4f7d-8cfe-c05adce87743 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:28.146393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5558f-7044-40fe-a3fc-95082f7443ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:28.147169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5558f-7044-40fe-a3fc-95082f7443ce admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:28.147523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5558f-7044-40fe-a3fc-95082f7443ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:28.147879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5558f-7044-40fe-a3fc-95082f7443ce admin admin] PATH_INFO: `/v3/projects/bc6137ea737d48bea2b6d2658340c89c/users/c6a143de00994b4ea8dbd231d0b828cc/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:28.150069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5558f-7044-40fe-a3fc-95082f7443ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6137ea737d48bea2b6d2658340c89c, user_id=c6a143de00994b4ea8dbd231d0b828cc, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:28.153010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5558f-7044-40fe-a3fc-95082f7443ce admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:28.165055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 964/1899] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:28 2022] PUT /identity/v3/projects/bc6137ea737d48bea2b6d2658340c89c/users/c6a143de00994b4ea8dbd231d0b828cc/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:28.178092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc997-1973-4810-8682-539e922d8f9d None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:28.178376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc997-1973-4810-8682-539e922d8f9d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:28.178646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc997-1973-4810-8682-539e922d8f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:28.217190 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-73cdc997-1973-4810-8682-539e922d8f9d None None] MFA Rules not processed for user `c6a143de00994b4ea8dbd231d0b828cc`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:28.219099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-73cdc997-1973-4810-8682-539e922d8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:28.227882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6a30e136da43ac92dabccf1f4937af'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:28.228708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6a30e136da43ac92dabccf1f4937af'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:28.238208 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cba2682-20dc-4ba1-a772-99487c34073f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6a30e136da43ac92dabccf1f4937af'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:28.249098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 936/1900] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:27 2022] DELETE /identity/v3/users/fc6a30e136da43ac92dabccf1f4937af => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:28.257622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f75e8-380b-4bd3-b021-0d850eca87c1 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:28.260900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f75e8-380b-4bd3-b021-0d850eca87c1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:28.260900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f75e8-380b-4bd3-b021-0d850eca87c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:28.293999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4d8f75e8-380b-4bd3-b021-0d850eca87c1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:28.295564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4d8f75e8-380b-4bd3-b021-0d850eca87c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:28.352798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 965/1901] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:58:28.366520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdc997-1973-4810-8682-539e922d8f9d None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:28.372013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-73cdc997-1973-4810-8682-539e922d8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:28.385662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 937/1902] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:28.396215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f75e8-380b-4bd3-b021-0d850eca87c1 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:28.398648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4d8f75e8-380b-4bd3-b021-0d850eca87c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:28.462405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdc997-1973-4810-8682-539e922d8f9d None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:28.473087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f75e8-380b-4bd3-b021-0d850eca87c1 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:28.477781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679712ab-6e8b-450c-a55f-355ca196cf53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:28.478624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679712ab-6e8b-450c-a55f-355ca196cf53 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:28.478906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679712ab-6e8b-450c-a55f-355ca196cf53 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:28.479178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679712ab-6e8b-450c-a55f-355ca196cf53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:28.491904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679712ab-6e8b-450c-a55f-355ca196cf53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:28.493407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679712ab-6e8b-450c-a55f-355ca196cf53 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:28.516615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 938/1903] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:58:28.529260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312544d8-a6cd-43a1-85df-149476a57c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:28.529885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312544d8-a6cd-43a1-85df-149476a57c6f service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:28.530220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312544d8-a6cd-43a1-85df-149476a57c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:28.530497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312544d8-a6cd-43a1-85df-149476a57c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:28.532339 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-312544d8-a6cd-43a1-85df-149476a57c6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:28.602540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312544d8-a6cd-43a1-85df-149476a57c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:28.604015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312544d8-a6cd-43a1-85df-149476a57c6f service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:28.624924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 966/1904] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:58:29.332594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679712ab-6e8b-450c-a55f-355ca196cf53 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:29.333987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-679712ab-6e8b-450c-a55f-355ca196cf53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:29.359072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312544d8-a6cd-43a1-85df-149476a57c6f service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:29.360776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-312544d8-a6cd-43a1-85df-149476a57c6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:29.361413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679712ab-6e8b-450c-a55f-355ca196cf53 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:29.368052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:29.372730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:29.372730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:29.372730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] PATH_INFO: `/v3/projects/567f5135c9884f4a81b8d669ae14266f` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:29.372730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567f5135c9884f4a81b8d669ae14266f)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:29.372730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:29.380847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312544d8-a6cd-43a1-85df-149476a57c6f service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:29.390265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:29.390923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:29.391202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:29.391474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] PATH_INFO: `/v3/users/42b29d27e90147bd9f7ce2d3ba88311f` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:29.392792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b29d27e90147bd9f7ce2d3ba88311f)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:29.394948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:29.695898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b29d27e90147bd9f7ce2d3ba88311f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:29.699495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567f5135c9884f4a81b8d669ae14266f', 'request_id': 'req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:29.704339 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b29d27e90147bd9f7ce2d3ba88311f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:29.799185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567f5135c9884f4a81b8d669ae14266f', 'request_id': 'req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:29.807306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567f5135c9884f4a81b8d669ae14266f', 'request_id': 'req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:29.818105 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] The token cache is being invalidate because project 567f5135c9884f4a81b8d669ae14266f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:29.818510 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:29.819233 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-517e0eb3-49da-4c78-9c2c-e1ab1ff22a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:29.821072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 939/1905] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:29 2022] DELETE /identity/v3/projects/567f5135c9884f4a81b8d669ae14266f => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:29.825799 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182e912-5c4d-450d-9ae2-5ffe432a8d1e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:29.826153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182e912-5c4d-450d-9ae2-5ffe432a8d1e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:29.826603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182e912-5c4d-450d-9ae2-5ffe432a8d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:29.849625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8182e912-5c4d-450d-9ae2-5ffe432a8d1e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:29.850915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8182e912-5c4d-450d-9ae2-5ffe432a8d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:29.897543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b29d27e90147bd9f7ce2d3ba88311f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:29.898831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b29d27e90147bd9f7ce2d3ba88311f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:29.900046 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-adcaf9ae-8fd1-40fa-b525-e221cba4fc7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b29d27e90147bd9f7ce2d3ba88311f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:29.916594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 940/1906] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:29.924821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 967/1907] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:29 2022] DELETE /identity/v3/users/42b29d27e90147bd9f7ce2d3ba88311f => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:29.927964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f78a9-e434-497d-acac-7bf82a0b7615 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:29.928283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f78a9-e434-497d-acac-7bf82a0b7615 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:29.928587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f78a9-e434-497d-acac-7bf82a0b7615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:29.929348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee6ff4-eed6-4f91-bca2-f6c0f33b9f1f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:29.929639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee6ff4-eed6-4f91-bca2-f6c0f33b9f1f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:29.929909 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee6ff4-eed6-4f91-bca2-f6c0f33b9f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:29.949234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-686f78a9-e434-497d-acac-7bf82a0b7615 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:29.950467 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-686f78a9-e434-497d-acac-7bf82a0b7615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:29.963536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d5ee6ff4-eed6-4f91-bca2-f6c0f33b9f1f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:29.965453 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d5ee6ff4-eed6-4f91-bca2-f6c0f33b9f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:30.019504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 941/1908] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:30.024729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f78a9-e434-497d-acac-7bf82a0b7615 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:30.040112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 968/1909] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:58:30.043582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f78a9-e434-497d-acac-7bf82a0b7615 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:30.051234 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee6ff4-eed6-4f91-bca2-f6c0f33b9f1f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:30.054885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d5ee6ff4-eed6-4f91-bca2-f6c0f33b9f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:30.056712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4a710-3e01-4dfb-a8c0-f56c409e4261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:30.057533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4a710-3e01-4dfb-a8c0-f56c409e4261 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:30.057975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4a710-3e01-4dfb-a8c0-f56c409e4261 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:30.058521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4a710-3e01-4dfb-a8c0-f56c409e4261 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:30.059265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4a710-3e01-4dfb-a8c0-f56c409e4261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:30.059772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4a710-3e01-4dfb-a8c0-f56c409e4261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:30.062384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4a710-3e01-4dfb-a8c0-f56c409e4261 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:30.075575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 942/1910] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:30.080279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4a710-3e01-4dfb-a8c0-f56c409e4261 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:30.091072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4a710-3e01-4dfb-a8c0-f56c409e4261 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:30.096540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab267ebd-a542-405e-98cb-b7fb1346e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:30.097748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab267ebd-a542-405e-98cb-b7fb1346e5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:30.098026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab267ebd-a542-405e-98cb-b7fb1346e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:30.098299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab267ebd-a542-405e-98cb-b7fb1346e5b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:30.098929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab267ebd-a542-405e-98cb-b7fb1346e5b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:30.101335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab267ebd-a542-405e-98cb-b7fb1346e5b7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:30.126639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee6ff4-eed6-4f91-bca2-f6c0f33b9f1f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:30.130260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15e3b-af78-4244-be9d-97bb91e839be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:30.130868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15e3b-af78-4244-be9d-97bb91e839be service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:30.131145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15e3b-af78-4244-be9d-97bb91e839be service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:30.131414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15e3b-af78-4244-be9d-97bb91e839be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:30.142211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a15e3b-af78-4244-be9d-97bb91e839be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:30.142698 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a15e3b-af78-4244-be9d-97bb91e839be service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:30.155906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 969/1911] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:30.263966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 943/1912] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:30 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:30.265540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15e3b-af78-4244-be9d-97bb91e839be service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:30.280234 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15e3b-af78-4244-be9d-97bb91e839be service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:30.349217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:30.369726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a7671-f61a-4c0e-b317-44c1fd878e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:30.370345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a7671-f61a-4c0e-b317-44c1fd878e2c admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:30.370641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a7671-f61a-4c0e-b317-44c1fd878e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:30.370917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a7671-f61a-4c0e-b317-44c1fd878e2c admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:30.371548 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a7671-f61a-4c0e-b317-44c1fd878e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:30.373565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a7671-f61a-4c0e-b317-44c1fd878e2c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:30.530531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 970/1913] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:30 2022] POST /identity/v3/users => generated 281 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:30.532703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab267ebd-a542-405e-98cb-b7fb1346e5b7 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:30.546638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab267ebd-a542-405e-98cb-b7fb1346e5b7 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:30.552868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec25da6-bf60-4338-b1dd-e4b34842e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:30.553593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25da6-bf60-4338-b1dd-e4b34842e9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:30.554095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25da6-bf60-4338-b1dd-e4b34842e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:30.554224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25da6-bf60-4338-b1dd-e4b34842e9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:30.555210 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec25da6-bf60-4338-b1dd-e4b34842e9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:30.557009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec25da6-bf60-4338-b1dd-e4b34842e9d9 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:30.568793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 944/1914] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:58:30.572882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a7671-f61a-4c0e-b317-44c1fd878e2c admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:30.585940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a7671-f61a-4c0e-b317-44c1fd878e2c admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:30.597221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684427fd-e95e-4542-9a01-25372919c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:30.597842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684427fd-e95e-4542-9a01-25372919c937 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:30.598159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684427fd-e95e-4542-9a01-25372919c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:30.598436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684427fd-e95e-4542-9a01-25372919c937 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:30.599159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684427fd-e95e-4542-9a01-25372919c937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:30.601003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684427fd-e95e-4542-9a01-25372919c937 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:30.611634 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 971/1915] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:30.616201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec25da6-bf60-4338-b1dd-e4b34842e9d9 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:30.633438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec25da6-bf60-4338-b1dd-e4b34842e9d9 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:30.633438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ef22a-00f9-43bf-9f4e-d392e4da474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:30.633438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef22a-00f9-43bf-9f4e-d392e4da474e admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:30.633438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef22a-00f9-43bf-9f4e-d392e4da474e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:30.633906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ef22a-00f9-43bf-9f4e-d392e4da474e admin admin] PATH_INFO: `/v3/projects/51b1bdbfe39045beae7358ad2fcc9aad/users/27adb592d14f4c9b8ee594f231ccf047/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:30.649430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef22a-00f9-43bf-9f4e-d392e4da474e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b1bdbfe39045beae7358ad2fcc9aad, user_id=27adb592d14f4c9b8ee594f231ccf047, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:30.652170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ef22a-00f9-43bf-9f4e-d392e4da474e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:30.745457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684427fd-e95e-4542-9a01-25372919c937 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:30.748182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-684427fd-e95e-4542-9a01-25372919c937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:30.766983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684427fd-e95e-4542-9a01-25372919c937 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:30.773677 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:30.774550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:30.774930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:30.775382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] PATH_INFO: `/v3/projects/0cd53842d55b4b3bba7d1db8fdca3723` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:30.776502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 945/1916] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:30 2022] PUT /identity/v3/projects/51b1bdbfe39045beae7358ad2fcc9aad/users/27adb592d14f4c9b8ee594f231ccf047/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:30.785216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd53842d55b4b3bba7d1db8fdca3723)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:30.785216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:30.790173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e00e-9f45-4243-b726-26dca2878178 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:30.790720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e00e-9f45-4243-b726-26dca2878178 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:30.791153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e00e-9f45-4243-b726-26dca2878178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:30.831926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-9b92e00e-9f45-4243-b726-26dca2878178 None None] MFA Rules not processed for user `27adb592d14f4c9b8ee594f231ccf047`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:30.833163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9b92e00e-9f45-4243-b726-26dca2878178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:30.887930 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:30.912942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 946/1917] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:58:30.924096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e00e-9f45-4243-b726-26dca2878178 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:30.925557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9b92e00e-9f45-4243-b726-26dca2878178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:30.943264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd53842d55b4b3bba7d1db8fdca3723', 'request_id': 'req-f93caac7-78d1-4d48-8160-284845a11f11'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:30.950054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd53842d55b4b3bba7d1db8fdca3723', 'request_id': 'req-f93caac7-78d1-4d48-8160-284845a11f11'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:30.958283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd53842d55b4b3bba7d1db8fdca3723', 'request_id': 'req-f93caac7-78d1-4d48-8160-284845a11f11'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:30.985618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e00e-9f45-4243-b726-26dca2878178 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:31.034590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc508d-8520-4314-85b7-eededed4ea87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:31.035846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc508d-8520-4314-85b7-eededed4ea87 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.036130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc508d-8520-4314-85b7-eededed4ea87 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.036406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc508d-8520-4314-85b7-eededed4ea87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.079134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] The token cache is being invalidate because project 0cd53842d55b4b3bba7d1db8fdca3723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:31.079739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:31.082410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f93caac7-78d1-4d48-8160-284845a11f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:31.091056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 972/1918] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:30 2022] DELETE /identity/v3/projects/0cd53842d55b4b3bba7d1db8fdca3723 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:31.091056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d82fa-f38c-45e5-94c5-a29b0bfc2fac None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.091056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d82fa-f38c-45e5-94c5-a29b0bfc2fac None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.091056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d82fa-f38c-45e5-94c5-a29b0bfc2fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.112287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-181d82fa-f38c-45e5-94c5-a29b0bfc2fac None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:31.112504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc508d-8520-4314-85b7-eededed4ea87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:31.113732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-181d82fa-f38c-45e5-94c5-a29b0bfc2fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:31.114045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc508d-8520-4314-85b7-eededed4ea87 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:31.124390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 947/1919] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:58:31.125789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1876a-9bb8-4b95-a76b-f126ae47897a None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.126207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1876a-9bb8-4b95-a76b-f126ae47897a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.126489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1876a-9bb8-4b95-a76b-f126ae47897a None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.127936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 948/1920] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 15:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:58:31.137682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab1a2-db8e-4193-aeaf-bdfe712b1893 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.138249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab1a2-db8e-4193-aeaf-bdfe712b1893 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.139003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab1a2-db8e-4193-aeaf-bdfe712b1893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.165405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-782ab1a2-db8e-4193-aeaf-bdfe712b1893 None None] MFA Rules not processed for user `9ecb4e7e9e3042adadd93229f8456eca`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:31.166895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-782ab1a2-db8e-4193-aeaf-bdfe712b1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:31.183831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 973/1921] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:58:31.194374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25ed8a-24f5-4c77-b3e5-12783a44099b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.194745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25ed8a-24f5-4c77-b3e5-12783a44099b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.195054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25ed8a-24f5-4c77-b3e5-12783a44099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.216549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-5c25ed8a-24f5-4c77-b3e5-12783a44099b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:31.217764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5c25ed8a-24f5-4c77-b3e5-12783a44099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:31.229484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 974/1922] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:31.231159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25ed8a-24f5-4c77-b3e5-12783a44099b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:31.240801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25ed8a-24f5-4c77-b3e5-12783a44099b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:31.246343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af05bd-13e8-4fe0-a75b-b5e0f65829a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:31.246504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af05bd-13e8-4fe0-a75b-b5e0f65829a5 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.246734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af05bd-13e8-4fe0-a75b-b5e0f65829a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.247085 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af05bd-13e8-4fe0-a75b-b5e0f65829a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.247435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 949/1923] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 15:58:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:31.247802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af05bd-13e8-4fe0-a75b-b5e0f65829a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:31.248656 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af05bd-13e8-4fe0-a75b-b5e0f65829a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:31.249753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af05bd-13e8-4fe0-a75b-b5e0f65829a5 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:31.254238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ab1a2-db8e-4193-aeaf-bdfe712b1893 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:31.256407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-782ab1a2-db8e-4193-aeaf-bdfe712b1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:31.268396 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 975/1924] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:58:31.270809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ab1a2-db8e-4193-aeaf-bdfe712b1893 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:31.272867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af05bd-13e8-4fe0-a75b-b5e0f65829a5 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:31.279587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24013e2f-51ad-436d-a436-e1266d5f9769 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecb4e7e9e3042adadd93229f8456eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:31.279587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24013e2f-51ad-436d-a436-e1266d5f9769 service placement] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.280034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24013e2f-51ad-436d-a436-e1266d5f9769 service placement] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.280315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24013e2f-51ad-436d-a436-e1266d5f9769 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.285721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af05bd-13e8-4fe0-a75b-b5e0f65829a5 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:31.291027 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24013e2f-51ad-436d-a436-e1266d5f9769 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:31.292971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0955d-a130-4f09-ab96-d31104497a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:31.292971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0955d-a130-4f09-ab96-d31104497a01 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.292971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0955d-a130-4f09-ab96-d31104497a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.293570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24013e2f-51ad-436d-a436-e1266d5f9769 service placement] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:31.293663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0955d-a130-4f09-ab96-d31104497a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.295003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0955d-a130-4f09-ab96-d31104497a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:31.297159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0955d-a130-4f09-ab96-d31104497a01 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:31.305140 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 950/1925] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:58:31.388961 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24013e2f-51ad-436d-a436-e1266d5f9769 service placement] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:31.391029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-24013e2f-51ad-436d-a436-e1266d5f9769 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:31.406829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24013e2f-51ad-436d-a436-e1266d5f9769 service placement] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:31.411633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:31.412297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.412668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.419091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] PATH_INFO: `/v3/users/b6bc6eecd2af449894f93233b8807544` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.419091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bc6eecd2af449894f93233b8807544)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:31.419091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:31.499172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 976/1926] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:31 2022] POST /identity/v3/projects => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:31.504041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0955d-a130-4f09-ab96-d31104497a01 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:31.564542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0955d-a130-4f09-ab96-d31104497a01 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:31.569128 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e491644-c66e-417c-a2b1-814d18f16c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:31.569754 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e491644-c66e-417c-a2b1-814d18f16c6c admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.570031 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e491644-c66e-417c-a2b1-814d18f16c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.570355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e491644-c66e-417c-a2b1-814d18f16c6c admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.570975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e491644-c66e-417c-a2b1-814d18f16c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:31.572974 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e491644-c66e-417c-a2b1-814d18f16c6c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:31.698545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bc6eecd2af449894f93233b8807544'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:31.710751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bc6eecd2af449894f93233b8807544'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:31.729493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 977/1927] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:31 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:31.729493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e491644-c66e-417c-a2b1-814d18f16c6c admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:31.729493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9e491644-c66e-417c-a2b1-814d18f16c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:31.790817 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e491644-c66e-417c-a2b1-814d18f16c6c admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:31.794553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c5e4c-775a-4b8d-b18c-8d8bc4cbecd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:31.795309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c5e4c-775a-4b8d-b18c-8d8bc4cbecd2 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.795593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c5e4c-775a-4b8d-b18c-8d8bc4cbecd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.795878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c5e4c-775a-4b8d-b18c-8d8bc4cbecd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.797849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-de7c5e4c-775a-4b8d-b18c-8d8bc4cbecd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:31.850378 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bc6eecd2af449894f93233b8807544'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:31.851086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bc6eecd2af449894f93233b8807544'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:31.858752 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bc6eecd2af449894f93233b8807544'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:31.861215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c5e4c-775a-4b8d-b18c-8d8bc4cbecd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:31.862692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c5e4c-775a-4b8d-b18c-8d8bc4cbecd2 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:31.868361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 951/1928] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:31 2022] DELETE /identity/v3/users/b6bc6eecd2af449894f93233b8807544 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:31.868361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:31.879094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:31.892604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 978/1929] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:31.967697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065f75b-7669-4408-99c7-f25ddb504c5f admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:31.974237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac347f5-3e45-4427-b33c-e1b087311052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:31.975065 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac347f5-3e45-4427-b33c-e1b087311052 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:31.975475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac347f5-3e45-4427-b33c-e1b087311052 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:31.975818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac347f5-3e45-4427-b33c-e1b087311052 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:31.976685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac347f5-3e45-4427-b33c-e1b087311052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:31.979038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac347f5-3e45-4427-b33c-e1b087311052 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:31.990559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 952/1930] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:31.995928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c5e4c-775a-4b8d-b18c-8d8bc4cbecd2 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:32.007958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c5e4c-775a-4b8d-b18c-8d8bc4cbecd2 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:32.013134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3067f1-d4fe-435a-84eb-268e32f61398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:32.013328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3067f1-d4fe-435a-84eb-268e32f61398 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:32.013604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3067f1-d4fe-435a-84eb-268e32f61398 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:32.014042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3067f1-d4fe-435a-84eb-268e32f61398 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:32.014793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3067f1-d4fe-435a-84eb-268e32f61398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:32.016562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3067f1-d4fe-435a-84eb-268e32f61398 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:32.030706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 979/1931] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:58:32.034582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac347f5-3e45-4427-b33c-e1b087311052 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:32.047577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac347f5-3e45-4427-b33c-e1b087311052 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:32.060736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1cfa8-96d7-498b-8d7c-217fd70ecc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:32.060736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1cfa8-96d7-498b-8d7c-217fd70ecc45 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:32.060736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1cfa8-96d7-498b-8d7c-217fd70ecc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:32.060736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1cfa8-96d7-498b-8d7c-217fd70ecc45 admin admin] PATH_INFO: `/v3/projects/f3e4d9a75ecd4709a817fa7cc7088f8a/users/a77d6c1a67e747a481595ff37c36b6f9/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:32.080336 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1cfa8-96d7-498b-8d7c-217fd70ecc45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e4d9a75ecd4709a817fa7cc7088f8a, user_id=a77d6c1a67e747a481595ff37c36b6f9, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:32.083751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1cfa8-96d7-498b-8d7c-217fd70ecc45 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:32.206482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3067f1-d4fe-435a-84eb-268e32f61398 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:32.206482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3f3067f1-d4fe-435a-84eb-268e32f61398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:32.230729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3067f1-d4fe-435a-84eb-268e32f61398 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:32.236938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:32.238190 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:32.238469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:32.238777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] PATH_INFO: `/v3/projects/cb1f5168df5d4518a8a3815ba04fe2c8` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:32.239865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1f5168df5d4518a8a3815ba04fe2c8)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:32.242022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:32.308848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 953/1932] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:32 2022] PUT /identity/v3/projects/f3e4d9a75ecd4709a817fa7cc7088f8a/users/a77d6c1a67e747a481595ff37c36b6f9/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:32.319606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172eca9-5256-4dfa-9877-7da8f8b18cc1 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:32.319879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172eca9-5256-4dfa-9877-7da8f8b18cc1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:32.320148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172eca9-5256-4dfa-9877-7da8f8b18cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:32.349862 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-6172eca9-5256-4dfa-9877-7da8f8b18cc1 None None] MFA Rules not processed for user `a77d6c1a67e747a481595ff37c36b6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:32.351150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6172eca9-5256-4dfa-9877-7da8f8b18cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:32.417596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 954/1933] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:58:32.429932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172eca9-5256-4dfa-9877-7da8f8b18cc1 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:32.431455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6172eca9-5256-4dfa-9877-7da8f8b18cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:32.470378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1f5168df5d4518a8a3815ba04fe2c8', 'request_id': 'req-a02fcb20-1234-42ce-8d8c-9574f4f560ee'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:32.477545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1f5168df5d4518a8a3815ba04fe2c8', 'request_id': 'req-a02fcb20-1234-42ce-8d8c-9574f4f560ee'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:32.484797 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1f5168df5d4518a8a3815ba04fe2c8', 'request_id': 'req-a02fcb20-1234-42ce-8d8c-9574f4f560ee'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:32.491865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172eca9-5256-4dfa-9877-7da8f8b18cc1 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:32.543064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a3e73-7b33-4ddb-83f5-f4d535a30c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:32.543677 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3e73-7b33-4ddb-83f5-f4d535a30c1e service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:32.543952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3e73-7b33-4ddb-83f5-f4d535a30c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:32.544221 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3e73-7b33-4ddb-83f5-f4d535a30c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:32.604781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a3e73-7b33-4ddb-83f5-f4d535a30c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:32.606266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a3e73-7b33-4ddb-83f5-f4d535a30c1e service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:32.611904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:32.616394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] The token cache is being invalidate because project cb1f5168df5d4518a8a3815ba04fe2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:32.616928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:32.617342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a02fcb20-1234-42ce-8d8c-9574f4f560ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:32.618012 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 955/1934] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:58:32.618821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 980/1935] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:32 2022] DELETE /identity/v3/projects/cb1f5168df5d4518a8a3815ba04fe2c8 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:32.623830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58a1f7-5c4b-43a4-abce-1cc9665631eb None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:32.624113 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58a1f7-5c4b-43a4-abce-1cc9665631eb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:32.624386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58a1f7-5c4b-43a4-abce-1cc9665631eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:32.644892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4f58a1f7-5c4b-43a4-abce-1cc9665631eb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:32.646119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4f58a1f7-5c4b-43a4-abce-1cc9665631eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:32.706448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 956/1936] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:32.715072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b808db8-3ae5-4346-adb5-42e7707bbc18 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:32.715359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b808db8-3ae5-4346-adb5-42e7707bbc18 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:32.715636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b808db8-3ae5-4346-adb5-42e7707bbc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:32.736537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4b808db8-3ae5-4346-adb5-42e7707bbc18 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:32.743593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4b808db8-3ae5-4346-adb5-42e7707bbc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:32.746254 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 981/1937] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:32.750701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58a1f7-5c4b-43a4-abce-1cc9665631eb None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:32.763927 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58a1f7-5c4b-43a4-abce-1cc9665631eb None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:32.765816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8efe9-0b08-481b-b53c-f97dbf036e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:32.766315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8efe9-0b08-481b-b53c-f97dbf036e1d admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:32.766598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8efe9-0b08-481b-b53c-f97dbf036e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:32.766867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8efe9-0b08-481b-b53c-f97dbf036e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:32.767522 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8efe9-0b08-481b-b53c-f97dbf036e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:32.767828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8efe9-0b08-481b-b53c-f97dbf036e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:32.769606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8efe9-0b08-481b-b53c-f97dbf036e1d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:32.786446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 957/1938] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:32.790822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b808db8-3ae5-4346-adb5-42e7707bbc18 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:32.803607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b808db8-3ae5-4346-adb5-42e7707bbc18 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:32.810415 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ffa69-9214-4762-b293-191c30280bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:32.811051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ffa69-9214-4762-b293-191c30280bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:32.811327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ffa69-9214-4762-b293-191c30280bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:32.811599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ffa69-9214-4762-b293-191c30280bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:32.812260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ffa69-9214-4762-b293-191c30280bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:32.816093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ffa69-9214-4762-b293-191c30280bc1 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:32.967529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 982/1939] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:32 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:32.972392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8efe9-0b08-481b-b53c-f97dbf036e1d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:32.982891 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8efe9-0b08-481b-b53c-f97dbf036e1d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:33.038773 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac71a-ae1e-45fe-8fac-aa43289f3219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:33.039388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac71a-ae1e-45fe-8fac-aa43289f3219 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:33.039665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac71a-ae1e-45fe-8fac-aa43289f3219 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:33.039935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ac71a-ae1e-45fe-8fac-aa43289f3219 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:33.040579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ac71a-ae1e-45fe-8fac-aa43289f3219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:33.042527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ac71a-ae1e-45fe-8fac-aa43289f3219 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:33.190809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 958/1940] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:32 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:33.192102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ffa69-9214-4762-b293-191c30280bc1 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:33.202741 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ffa69-9214-4762-b293-191c30280bc1 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:33.208365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28215d-4cb6-45a4-a82e-60427b4cbd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:33.209006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28215d-4cb6-45a4-a82e-60427b4cbd2f admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:33.209285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28215d-4cb6-45a4-a82e-60427b4cbd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:33.209557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28215d-4cb6-45a4-a82e-60427b4cbd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:33.210226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28215d-4cb6-45a4-a82e-60427b4cbd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:33.211795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28215d-4cb6-45a4-a82e-60427b4cbd2f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:33.221796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 983/1941] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:33.226419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac71a-ae1e-45fe-8fac-aa43289f3219 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:33.236934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ac71a-ae1e-45fe-8fac-aa43289f3219 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:33.241488 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb851f77-7a76-423c-a24d-2dbc83f4ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:33.242155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851f77-7a76-423c-a24d-2dbc83f4ea6b admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:33.242429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851f77-7a76-423c-a24d-2dbc83f4ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:33.242729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb851f77-7a76-423c-a24d-2dbc83f4ea6b admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:33.243368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb851f77-7a76-423c-a24d-2dbc83f4ea6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:33.245004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb851f77-7a76-423c-a24d-2dbc83f4ea6b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:33.255747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 959/1942] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:33.259824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28215d-4cb6-45a4-a82e-60427b4cbd2f admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:33.271940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28215d-4cb6-45a4-a82e-60427b4cbd2f admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:33.276934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fdf22-83ed-4b82-b36b-2e18849940e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:33.277685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fdf22-83ed-4b82-b36b-2e18849940e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:33.277964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fdf22-83ed-4b82-b36b-2e18849940e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:33.278230 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fdf22-83ed-4b82-b36b-2e18849940e6 admin admin] PATH_INFO: `/v3/projects/cc986b271ecc4ef1880077175d546b04/users/d630b75517634f6e9cf0613661fb7695/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:33.293802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fdf22-83ed-4b82-b36b-2e18849940e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc986b271ecc4ef1880077175d546b04, user_id=d630b75517634f6e9cf0613661fb7695, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:33.296727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fdf22-83ed-4b82-b36b-2e18849940e6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:33.442906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 984/1943] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:33 2022] PUT /identity/v3/projects/cc986b271ecc4ef1880077175d546b04/users/d630b75517634f6e9cf0613661fb7695/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:33.449090 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2123e8f-44b1-474f-a21a-9e8061d167bd None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:33.449427 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2123e8f-44b1-474f-a21a-9e8061d167bd None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:33.449798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2123e8f-44b1-474f-a21a-9e8061d167bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:33.469658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e2123e8f-44b1-474f-a21a-9e8061d167bd None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:33.471100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e2123e8f-44b1-474f-a21a-9e8061d167bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:33.532181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 960/1944] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:33.545966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fdf22-83ed-4b82-b36b-2e18849940e6 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:33.547783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-961fdf22-83ed-4b82-b36b-2e18849940e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:33.557997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:33.622551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fdf22-83ed-4b82-b36b-2e18849940e6 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:33.626651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5538e1b-21b2-46e6-b1c8-673afba83600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:33.627412 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5538e1b-21b2-46e6-b1c8-673afba83600 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:33.627831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5538e1b-21b2-46e6-b1c8-673afba83600 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:33.628749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5538e1b-21b2-46e6-b1c8-673afba83600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:33.644930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5538e1b-21b2-46e6-b1c8-673afba83600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:33.644930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5538e1b-21b2-46e6-b1c8-673afba83600 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:33.661209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 985/1945] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:35.589840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2123e8f-44b1-474f-a21a-9e8061d167bd None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:35.591330 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e2123e8f-44b1-474f-a21a-9e8061d167bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:35.604434 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2123e8f-44b1-474f-a21a-9e8061d167bd None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:35.610195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:35.610880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:35.611159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:35.611431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] PATH_INFO: `/v3/users/4cac1aacdc2a432a95a25df248088739` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:35.613212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cac1aacdc2a432a95a25df248088739)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:35.616227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:36.054491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cac1aacdc2a432a95a25df248088739'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:36.072256 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cac1aacdc2a432a95a25df248088739'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:36.348234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cac1aacdc2a432a95a25df248088739'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:36.348877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cac1aacdc2a432a95a25df248088739'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:36.356283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cac1aacdc2a432a95a25df248088739'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:36.362323 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 961/1946] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:35 2022] DELETE /identity/v3/users/4cac1aacdc2a432a95a25df248088739 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:36.367766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490dce7-d50c-4691-8545-787527a4caab None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:36.368248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490dce7-d50c-4691-8545-787527a4caab None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:36.368369 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490dce7-d50c-4691-8545-787527a4caab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:36.386919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d490dce7-d50c-4691-8545-787527a4caab None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:36.388125 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d490dce7-d50c-4691-8545-787527a4caab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:36.447446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 986/1947] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:36.457391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:36.458849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:36.543181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1abd-8fa6-4875-97c9-01b9fdc6961c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:36.549389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689ab0c-219a-4c1f-a6af-56039495fde7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:36.549389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689ab0c-219a-4c1f-a6af-56039495fde7 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:36.549389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689ab0c-219a-4c1f-a6af-56039495fde7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:36.549690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689ab0c-219a-4c1f-a6af-56039495fde7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:36.568001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689ab0c-219a-4c1f-a6af-56039495fde7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:36.569649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689ab0c-219a-4c1f-a6af-56039495fde7 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:36.582757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 962/1948] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:37.254225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490dce7-d50c-4691-8545-787527a4caab None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:37.256484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d490dce7-d50c-4691-8545-787527a4caab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:37.288474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490dce7-d50c-4691-8545-787527a4caab None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:37.294637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:37.295806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:37.296331 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:37.296740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] PATH_INFO: `/v3/projects/bfc33c5f2ea34ecc8571c01ae49a8d65` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:37.298182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc33c5f2ea34ecc8571c01ae49a8d65)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:37.300951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:37.475979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc33c5f2ea34ecc8571c01ae49a8d65', 'request_id': 'req-e3c4a390-e498-4cc9-8c3d-89fa813936cd'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:37.482106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc33c5f2ea34ecc8571c01ae49a8d65', 'request_id': 'req-e3c4a390-e498-4cc9-8c3d-89fa813936cd'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:37.490475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc33c5f2ea34ecc8571c01ae49a8d65', 'request_id': 'req-e3c4a390-e498-4cc9-8c3d-89fa813936cd'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:37.600623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:37.650291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] The token cache is being invalidate because project bfc33c5f2ea34ecc8571c01ae49a8d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:37.651708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:37.652019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:37.654660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 987/1949] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:37 2022] DELETE /identity/v3/projects/bfc33c5f2ea34ecc8571c01ae49a8d65 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:37.663193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689ab0c-219a-4c1f-a6af-56039495fde7 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:37.676660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689ab0c-219a-4c1f-a6af-56039495fde7 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:37.755732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:37.758228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:37.758228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:37.758228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] PATH_INFO: `/v3/users/6f5da2d9fb5142f78e75fb69b3e534d3` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:37.758228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5da2d9fb5142f78e75fb69b3e534d3)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:37.760084 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:38.279167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5da2d9fb5142f78e75fb69b3e534d3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:38.312376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5da2d9fb5142f78e75fb69b3e534d3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:38.440779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:38.447043 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:38.465851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4a390-e498-4cc9-8c3d-89fa813936cd admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:38.467915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5da2d9fb5142f78e75fb69b3e534d3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:38.475654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5da2d9fb5142f78e75fb69b3e534d3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:38.475793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:38.475793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:38.475793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:38.475793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] PATH_INFO: `/v3/users/f825c3b2f16d42f6b9c725096117b278` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:38.476599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f825c3b2f16d42f6b9c725096117b278)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:38.478657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:38.482106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5da2d9fb5142f78e75fb69b3e534d3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:38.489435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 963/1950] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:37 2022] DELETE /identity/v3/users/6f5da2d9fb5142f78e75fb69b3e534d3 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:38.631895 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:38.698337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:38.700625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:38.772736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be69e-d2a9-4154-89d4-b85994e0c1e5 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:38.777963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:38.778806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:38.779088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:38.779365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] PATH_INFO: `/v3/users/a77d6c1a67e747a481595ff37c36b6f9` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:38.780538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77d6c1a67e747a481595ff37c36b6f9)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:38.782684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:38.870731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f825c3b2f16d42f6b9c725096117b278'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:38.880834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f825c3b2f16d42f6b9c725096117b278'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.053109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f825c3b2f16d42f6b9c725096117b278'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.054940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f825c3b2f16d42f6b9c725096117b278'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.056088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-69f446dc-54be-4234-ba23-25597f2a30c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f825c3b2f16d42f6b9c725096117b278'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.078129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 988/1951] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:38 2022] DELETE /identity/v3/users/f825c3b2f16d42f6b9c725096117b278 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:39.083006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8792ff2-326c-4210-af85-d9c73b3feeed None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:39.083646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8792ff2-326c-4210-af85-d9c73b3feeed None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:39.083956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8792ff2-326c-4210-af85-d9c73b3feeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:39.106110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c8792ff2-326c-4210-af85-d9c73b3feeed None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:39.107228 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c8792ff2-326c-4210-af85-d9c73b3feeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:39.187189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 989/1952] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:39.188415 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8792ff2-326c-4210-af85-d9c73b3feeed None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:39.189943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c8792ff2-326c-4210-af85-d9c73b3feeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:39.203775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8792ff2-326c-4210-af85-d9c73b3feeed None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:39.208875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:39.209995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:39.210480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:39.210911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] PATH_INFO: `/v3/projects/f54d1aece4694847ba2944fff3f9109d` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:39.212416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54d1aece4694847ba2944fff3f9109d)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:39.214562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:39.227614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77d6c1a67e747a481595ff37c36b6f9'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.244817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77d6c1a67e747a481595ff37c36b6f9'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.400364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77d6c1a67e747a481595ff37c36b6f9'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.401508 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77d6c1a67e747a481595ff37c36b6f9'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.411523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77d6c1a67e747a481595ff37c36b6f9'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.422444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 964/1953] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:38 2022] DELETE /identity/v3/users/a77d6c1a67e747a481595ff37c36b6f9 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:39.422444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:39.423319 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:39.433879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54d1aece4694847ba2944fff3f9109d', 'request_id': 'req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.441692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54d1aece4694847ba2944fff3f9109d', 'request_id': 'req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.450382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54d1aece4694847ba2944fff3f9109d', 'request_id': 'req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.492529 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d222c-d962-488c-96a4-7e8548bf196d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:39.496166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eb939-fdbb-4eb5-9426-6dadf85f450a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:39.496858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eb939-fdbb-4eb5-9426-6dadf85f450a service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:39.497133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eb939-fdbb-4eb5-9426-6dadf85f450a service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:39.497400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eb939-fdbb-4eb5-9426-6dadf85f450a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:39.499102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c65eb939-fdbb-4eb5-9426-6dadf85f450a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:39.560583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eb939-fdbb-4eb5-9426-6dadf85f450a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:39.562231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eb939-fdbb-4eb5-9426-6dadf85f450a service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:39.571909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 965/1954] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:39.573451 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aca39-9cb5-45bd-80a6-bc140a78979b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:39.573732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aca39-9cb5-45bd-80a6-bc140a78979b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:39.574003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aca39-9cb5-45bd-80a6-bc140a78979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:39.592663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-f01aca39-9cb5-45bd-80a6-bc140a78979b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:39.593863 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f01aca39-9cb5-45bd-80a6-bc140a78979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:39.601983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 966/1955] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:39.611733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aca39-9cb5-45bd-80a6-bc140a78979b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:39.613914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f01aca39-9cb5-45bd-80a6-bc140a78979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:39.626344 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aca39-9cb5-45bd-80a6-bc140a78979b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:39.630092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad2c4c-7cff-464f-a6d8-50c70f5d9516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:39.630732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad2c4c-7cff-464f-a6d8-50c70f5d9516 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:39.631034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad2c4c-7cff-464f-a6d8-50c70f5d9516 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:39.631332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad2c4c-7cff-464f-a6d8-50c70f5d9516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:39.642621 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] The token cache is being invalidate because project f54d1aece4694847ba2944fff3f9109d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:39.643221 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad2c4c-7cff-464f-a6d8-50c70f5d9516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:39.644298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.645197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad2c4c-7cff-464f-a6d8-50c70f5d9516 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:39.645651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-20bcf4c9-e9ad-4439-8dbc-498cc09e614a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:39.654708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 990/1956] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:39 2022] DELETE /identity/v3/projects/f54d1aece4694847ba2944fff3f9109d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:39.656099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 967/1957] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:58:39.657122 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c062a-e8f4-4a20-90e8-2ae7ed115f0b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:39.658438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c062a-e8f4-4a20-90e8-2ae7ed115f0b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:39.658875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c062a-e8f4-4a20-90e8-2ae7ed115f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:39.718712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-2b4c062a-e8f4-4a20-90e8-2ae7ed115f0b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:39.726671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2b4c062a-e8f4-4a20-90e8-2ae7ed115f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:39.743915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 991/1958] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:39.746365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5313a84-8b41-4b7d-9245-14cc81f7305e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:39.746824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5313a84-8b41-4b7d-9245-14cc81f7305e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:39.747269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5313a84-8b41-4b7d-9245-14cc81f7305e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:39.773174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c5313a84-8b41-4b7d-9245-14cc81f7305e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:39.774420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c5313a84-8b41-4b7d-9245-14cc81f7305e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:39.792504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 968/1959] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:39.796976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c062a-e8f4-4a20-90e8-2ae7ed115f0b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:39.809408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c062a-e8f4-4a20-90e8-2ae7ed115f0b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:39.815813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219c75-0a83-4183-8537-d5547dec1668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:39.816236 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219c75-0a83-4183-8537-d5547dec1668 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:39.816498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219c75-0a83-4183-8537-d5547dec1668 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:39.816802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219c75-0a83-4183-8537-d5547dec1668 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:39.817459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219c75-0a83-4183-8537-d5547dec1668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:39.817760 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219c75-0a83-4183-8537-d5547dec1668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:39.819478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219c75-0a83-4183-8537-d5547dec1668 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:39.835915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 992/1960] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:39.840204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5313a84-8b41-4b7d-9245-14cc81f7305e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:39.852644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5313a84-8b41-4b7d-9245-14cc81f7305e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:39.869094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cef3a9-fb56-4e46-8793-9a5851f79986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:39.869739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cef3a9-fb56-4e46-8793-9a5851f79986 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:39.870017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cef3a9-fb56-4e46-8793-9a5851f79986 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:39.870284 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cef3a9-fb56-4e46-8793-9a5851f79986 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:39.870947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cef3a9-fb56-4e46-8793-9a5851f79986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:39.873240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cef3a9-fb56-4e46-8793-9a5851f79986 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:40.184838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 969/1961] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:39 2022] POST /identity/v3/projects => generated 381 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:40.189008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219c75-0a83-4183-8537-d5547dec1668 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:40.208220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219c75-0a83-4183-8537-d5547dec1668 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:40.293756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328c6d6-78cc-4ead-bf31-d415997b6d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:40.293756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328c6d6-78cc-4ead-bf31-d415997b6d55 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:40.293756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328c6d6-78cc-4ead-bf31-d415997b6d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:40.293756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328c6d6-78cc-4ead-bf31-d415997b6d55 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:40.294074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328c6d6-78cc-4ead-bf31-d415997b6d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:40.296851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328c6d6-78cc-4ead-bf31-d415997b6d55 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:40.598243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 993/1962] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:40 2022] POST /identity/v3/users => generated 291 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:40.602519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cef3a9-fb56-4e46-8793-9a5851f79986 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:40.613626 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cef3a9-fb56-4e46-8793-9a5851f79986 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:40.618806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5cb6-b6f1-4599-b7ef-60bde3ca1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:40.619261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5cb6-b6f1-4599-b7ef-60bde3ca1b3b admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:40.619534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5cb6-b6f1-4599-b7ef-60bde3ca1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:40.619801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5cb6-b6f1-4599-b7ef-60bde3ca1b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:40.620653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5cb6-b6f1-4599-b7ef-60bde3ca1b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:40.622204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5cb6-b6f1-4599-b7ef-60bde3ca1b3b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:40.634212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 970/1963] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:40.638550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328c6d6-78cc-4ead-bf31-d415997b6d55 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:40.649171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328c6d6-78cc-4ead-bf31-d415997b6d55 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:40.654148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cbcdc-3bd8-4151-ba63-dc12bdf68bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:40.654713 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cbcdc-3bd8-4151-ba63-dc12bdf68bcf admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:40.654994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cbcdc-3bd8-4151-ba63-dc12bdf68bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:40.655269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cbcdc-3bd8-4151-ba63-dc12bdf68bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:40.655922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cbcdc-3bd8-4151-ba63-dc12bdf68bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:40.657579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cbcdc-3bd8-4151-ba63-dc12bdf68bcf admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:40.669350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 994/1964] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:40.673683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5cb6-b6f1-4599-b7ef-60bde3ca1b3b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:40.690235 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cbcdc-3bd8-4151-ba63-dc12bdf68bcf admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:40.693380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5cb6-b6f1-4599-b7ef-60bde3ca1b3b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:40.695155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-107cbcdc-3bd8-4151-ba63-dc12bdf68bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:40.699474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac0ba2-97de-44a9-b144-a12c9925918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:40.700231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac0ba2-97de-44a9-b144-a12c9925918e admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:40.700728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac0ba2-97de-44a9-b144-a12c9925918e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:40.701160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac0ba2-97de-44a9-b144-a12c9925918e admin admin] PATH_INFO: `/v3/projects/7ecc16adb5134e56ab67b9e803007b7d/users/1692f7dd9fe544ad8632c800681d9f53/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:40.721770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac0ba2-97de-44a9-b144-a12c9925918e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecc16adb5134e56ab67b9e803007b7d, user_id=1692f7dd9fe544ad8632c800681d9f53, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:40.731720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cbcdc-3bd8-4151-ba63-dc12bdf68bcf admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:40.732617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac0ba2-97de-44a9-b144-a12c9925918e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:40.741345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:40.742015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:40.742299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:40.742573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] PATH_INFO: `/v3/projects/f3e4d9a75ecd4709a817fa7cc7088f8a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:40.743756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e4d9a75ecd4709a817fa7cc7088f8a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:40.745729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:40.888651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 971/1965] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:40 2022] PUT /identity/v3/projects/7ecc16adb5134e56ab67b9e803007b7d/users/1692f7dd9fe544ad8632c800681d9f53/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:40.888651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac0ba2-97de-44a9-b144-a12c9925918e admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:40.892765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8eac0ba2-97de-44a9-b144-a12c9925918e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:40.949492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e4d9a75ecd4709a817fa7cc7088f8a', 'request_id': 'req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:40.957166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e4d9a75ecd4709a817fa7cc7088f8a', 'request_id': 'req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:40.966280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e4d9a75ecd4709a817fa7cc7088f8a', 'request_id': 'req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:40.989155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac0ba2-97de-44a9-b144-a12c9925918e admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:41.065274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:41.065970 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:41.066252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:41.066560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] PATH_INFO: `/v3/projects/e5028c1f4f194ed6988d94566ebafd70` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:41.067743 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5028c1f4f194ed6988d94566ebafd70)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:41.070119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:41.153050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] The token cache is being invalidate because project f3e4d9a75ecd4709a817fa7cc7088f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:41.153343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:41.154182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7c858ee5-1b4d-4085-ac5f-9d2cf501f065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:41.155689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 995/1966] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:40 2022] DELETE /identity/v3/projects/f3e4d9a75ecd4709a817fa7cc7088f8a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:41.156926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a5160-c0cd-4345-b9c5-e00f6d72aeef None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:41.157372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a5160-c0cd-4345-b9c5-e00f6d72aeef None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:41.157777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a5160-c0cd-4345-b9c5-e00f6d72aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:41.199051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-869a5160-c0cd-4345-b9c5-e00f6d72aeef None None] MFA Rules not processed for user `1692f7dd9fe544ad8632c800681d9f53`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:41.200383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-869a5160-c0cd-4345-b9c5-e00f6d72aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:41.291272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 996/1967] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:41.296018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a5160-c0cd-4345-b9c5-e00f6d72aeef None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:41.297941 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-869a5160-c0cd-4345-b9c5-e00f6d72aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:41.315971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a5160-c0cd-4345-b9c5-e00f6d72aeef None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:41.321828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b41ad5-62a6-4bdd-9885-1efc2d56ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:41.323016 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b41ad5-62a6-4bdd-9885-1efc2d56ea3e admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:41.323532 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b41ad5-62a6-4bdd-9885-1efc2d56ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:41.324004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b41ad5-62a6-4bdd-9885-1efc2d56ea3e admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:41.324960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b41ad5-62a6-4bdd-9885-1efc2d56ea3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:41.329912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b41ad5-62a6-4bdd-9885-1efc2d56ea3e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:41.515877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5028c1f4f194ed6988d94566ebafd70', 'request_id': 'req-13a0f6ff-e7f2-4901-aae7-037122065264'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:41.549533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 997/1968] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:41 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:41.550994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846c1b4-6ebb-4a87-b635-83bc57a63808 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:41.551282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846c1b4-6ebb-4a87-b635-83bc57a63808 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:41.551557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846c1b4-6ebb-4a87-b635-83bc57a63808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:41.583025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d846c1b4-6ebb-4a87-b635-83bc57a63808 None None] MFA Rules not processed for user `d630b75517634f6e9cf0613661fb7695`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:41.584605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d846c1b4-6ebb-4a87-b635-83bc57a63808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:41.645050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5028c1f4f194ed6988d94566ebafd70', 'request_id': 'req-13a0f6ff-e7f2-4901-aae7-037122065264'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:41.652040 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5028c1f4f194ed6988d94566ebafd70', 'request_id': 'req-13a0f6ff-e7f2-4901-aae7-037122065264'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:41.656554 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 998/1969] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:41.672997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846c1b4-6ebb-4a87-b635-83bc57a63808 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:41.680001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] The token cache is being invalidate because project e5028c1f4f194ed6988d94566ebafd70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:41.680297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:41.681083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-13a0f6ff-e7f2-4901-aae7-037122065264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:41.686211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 972/1970] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:40 2022] DELETE /identity/v3/projects/e5028c1f4f194ed6988d94566ebafd70 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:41.686211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8e60d-f66f-4a63-aa6b-960a966213bf None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:41.686211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8e60d-f66f-4a63-aa6b-960a966213bf None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:41.686211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8e60d-f66f-4a63-aa6b-960a966213bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:41.717435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c5c8e60d-f66f-4a63-aa6b-960a966213bf None None] MFA Rules not processed for user `d630b75517634f6e9cf0613661fb7695`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:41.719920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c5c8e60d-f66f-4a63-aa6b-960a966213bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:41.733286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 973/1971] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:41.734313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8e60d-f66f-4a63-aa6b-960a966213bf None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:41.735813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c5c8e60d-f66f-4a63-aa6b-960a966213bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:41.754539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846c1b4-6ebb-4a87-b635-83bc57a63808 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:41.756568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8e60d-f66f-4a63-aa6b-960a966213bf None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:41.762307 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:41.762707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01795140-997b-4759-8752-85eac32e71ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:41.763067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:41.763380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01795140-997b-4759-8752-85eac32e71ad admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:41.763489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:41.763668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01795140-997b-4759-8752-85eac32e71ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:41.763764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] PATH_INFO: `/v3/users/c6a143de00994b4ea8dbd231d0b828cc` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:41.763952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01795140-997b-4759-8752-85eac32e71ad admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:41.764649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01795140-997b-4759-8752-85eac32e71ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:41.766674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01795140-997b-4759-8752-85eac32e71ad admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:41.768412 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a143de00994b4ea8dbd231d0b828cc)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:41.770973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:41.874081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 999/1972] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:41 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:41.875204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01795140-997b-4759-8752-85eac32e71ad admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:41.886142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-01795140-997b-4759-8752-85eac32e71ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:41.970810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:41.977386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01795140-997b-4759-8752-85eac32e71ad admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:41.983260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982955f-47f6-498b-baff-8b9100f2104f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:41.983982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982955f-47f6-498b-baff-8b9100f2104f service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:41.984259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982955f-47f6-498b-baff-8b9100f2104f service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:41.984684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982955f-47f6-498b-baff-8b9100f2104f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:41.986646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7982955f-47f6-498b-baff-8b9100f2104f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:41.997843 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982955f-47f6-498b-baff-8b9100f2104f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:41.999443 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982955f-47f6-498b-baff-8b9100f2104f service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:42.010616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1000/1973] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:42.011655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982955f-47f6-498b-baff-8b9100f2104f service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:42.013103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7982955f-47f6-498b-baff-8b9100f2104f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:42.015963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a143de00994b4ea8dbd231d0b828cc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:42.027932 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982955f-47f6-498b-baff-8b9100f2104f service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:42.031347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a143de00994b4ea8dbd231d0b828cc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:42.036001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3a3e-b9a0-4506-9f11-d4cd426a96dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:42.037447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3a3e-b9a0-4506-9f11-d4cd426a96dc admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:42.037831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3a3e-b9a0-4506-9f11-d4cd426a96dc admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:42.038595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3a3e-b9a0-4506-9f11-d4cd426a96dc admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:42.039290 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e3a3e-b9a0-4506-9f11-d4cd426a96dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:42.041187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e3a3e-b9a0-4506-9f11-d4cd426a96dc admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:42.053320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1001/1974] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:42.057586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3a3e-b9a0-4506-9f11-d4cd426a96dc admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:42.070703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3a3e-b9a0-4506-9f11-d4cd426a96dc admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:42.075698 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af4604-f0ae-4763-8589-940cedc584ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:42.076852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af4604-f0ae-4763-8589-940cedc584ba admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:42.077212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af4604-f0ae-4763-8589-940cedc584ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:42.077559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af4604-f0ae-4763-8589-940cedc584ba admin admin] PATH_INFO: `/v3/projects/c51697181a7e4e778ff93020304f651a/users/8541a5c194ea46dd940cb4e25c69b388/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:42.096227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af4604-f0ae-4763-8589-940cedc584ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51697181a7e4e778ff93020304f651a, user_id=8541a5c194ea46dd940cb4e25c69b388, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:42.099500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af4604-f0ae-4763-8589-940cedc584ba admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:42.222348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a143de00994b4ea8dbd231d0b828cc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:42.223236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a143de00994b4ea8dbd231d0b828cc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:42.233079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a143de00994b4ea8dbd231d0b828cc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:42.241288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 974/1975] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:41 2022] DELETE /identity/v3/users/c6a143de00994b4ea8dbd231d0b828cc => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:42.343639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1002/1976] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:42 2022] PUT /identity/v3/projects/c51697181a7e4e778ff93020304f651a/users/8541a5c194ea46dd940cb4e25c69b388/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:42.348390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:42.350173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:42.443151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb35fa-90c0-4703-a17a-edd29b4f5c9f admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:42.511822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1512610-7dc6-49bc-96b9-d61eb6361792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:42.512548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512610-7dc6-49bc-96b9-d61eb6361792 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:42.513406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512610-7dc6-49bc-96b9-d61eb6361792 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:42.513406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1512610-7dc6-49bc-96b9-d61eb6361792 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:42.513761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1512610-7dc6-49bc-96b9-d61eb6361792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:42.515392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1512610-7dc6-49bc-96b9-d61eb6361792 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:42.529697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 975/1977] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:42.531167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af4604-f0ae-4763-8589-940cedc584ba admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:42.543184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af4604-f0ae-4763-8589-940cedc584ba admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:42.551086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491a57d-2757-4eed-bcf2-62b0449e623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:42.552007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491a57d-2757-4eed-bcf2-62b0449e623c admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:42.552390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491a57d-2757-4eed-bcf2-62b0449e623c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:42.552821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491a57d-2757-4eed-bcf2-62b0449e623c admin admin] PATH_INFO: `/v3/projects/c51697181a7e4e778ff93020304f651a/users/8541a5c194ea46dd940cb4e25c69b388/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:42.556926 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491a57d-2757-4eed-bcf2-62b0449e623c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51697181a7e4e778ff93020304f651a, user_id=8541a5c194ea46dd940cb4e25c69b388, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:42.561904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491a57d-2757-4eed-bcf2-62b0449e623c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:42.578541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1003/1978] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:42 2022] PUT /identity/v3/projects/c51697181a7e4e778ff93020304f651a/users/8541a5c194ea46dd940cb4e25c69b388/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:42.589392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128d57f-5477-48df-ad1a-17827cfcef02 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:42.589678 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128d57f-5477-48df-ad1a-17827cfcef02 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:42.589947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128d57f-5477-48df-ad1a-17827cfcef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:42.656425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7128d57f-5477-48df-ad1a-17827cfcef02 None None] MFA Rules not processed for user `8541a5c194ea46dd940cb4e25c69b388`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:42.658107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7128d57f-5477-48df-ad1a-17827cfcef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:42.740686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 976/1979] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:42.752847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491a57d-2757-4eed-bcf2-62b0449e623c admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:42.755229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5491a57d-2757-4eed-bcf2-62b0449e623c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:42.812809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491a57d-2757-4eed-bcf2-62b0449e623c admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:42.817590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5342b8-7b13-4b6a-bb46-46975234521b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:42.818204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5342b8-7b13-4b6a-bb46-46975234521b service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:42.818486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5342b8-7b13-4b6a-bb46-46975234521b service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:42.818758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5342b8-7b13-4b6a-bb46-46975234521b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:42.828559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5342b8-7b13-4b6a-bb46-46975234521b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:42.830010 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5342b8-7b13-4b6a-bb46-46975234521b service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:42.841739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1004/1980] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:42.888262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128d57f-5477-48df-ad1a-17827cfcef02 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:42.895520 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7128d57f-5477-48df-ad1a-17827cfcef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:42.950877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e283-0adc-47af-b7ae-d50514b6dfeb None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:42.951237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e283-0adc-47af-b7ae-d50514b6dfeb None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:42.951664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e283-0adc-47af-b7ae-d50514b6dfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:42.999702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-caf0e283-0adc-47af-b7ae-d50514b6dfeb None None] MFA Rules not processed for user `d630b75517634f6e9cf0613661fb7695`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:43.001025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-caf0e283-0adc-47af-b7ae-d50514b6dfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:43.019139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128d57f-5477-48df-ad1a-17827cfcef02 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:43.026177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:43.036778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:43.055880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:43.055880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] PATH_INFO: `/v3/projects/bc6137ea737d48bea2b6d2658340c89c` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:43.055880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6137ea737d48bea2b6d2658340c89c)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:43.055880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:43.122185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1005/1981] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:43.127706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0e283-0adc-47af-b7ae-d50514b6dfeb None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:43.129179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-caf0e283-0adc-47af-b7ae-d50514b6dfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:43.144825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0e283-0adc-47af-b7ae-d50514b6dfeb None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:43.152440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1324a5c-68d2-498e-8971-72ffb65a308c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:43.161636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1324a5c-68d2-498e-8971-72ffb65a308c service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:43.161923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1324a5c-68d2-498e-8971-72ffb65a308c service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:43.162336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1324a5c-68d2-498e-8971-72ffb65a308c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:43.164779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a1324a5c-68d2-498e-8971-72ffb65a308c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:43.220831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6137ea737d48bea2b6d2658340c89c', 'request_id': 'req-c738d09e-875a-4cff-be6e-26855f566211'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:43.240076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1324a5c-68d2-498e-8971-72ffb65a308c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:43.241563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1324a5c-68d2-498e-8971-72ffb65a308c service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:43.251180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1006/1982] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:43.320099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6137ea737d48bea2b6d2658340c89c', 'request_id': 'req-c738d09e-875a-4cff-be6e-26855f566211'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:43.330554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6137ea737d48bea2b6d2658340c89c', 'request_id': 'req-c738d09e-875a-4cff-be6e-26855f566211'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:43.345787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] The token cache is being invalidate because project bc6137ea737d48bea2b6d2658340c89c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:43.346468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:43.347877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c738d09e-875a-4cff-be6e-26855f566211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:43.354747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 977/1983] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:42 2022] DELETE /identity/v3/projects/bc6137ea737d48bea2b6d2658340c89c => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:43.356746 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4629a-395b-4b33-997b-66d44c49ca68 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:43.357140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4629a-395b-4b33-997b-66d44c49ca68 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:43.357952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4629a-395b-4b33-997b-66d44c49ca68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:43.381980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-15e4629a-395b-4b33-997b-66d44c49ca68 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:43.383270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-15e4629a-395b-4b33-997b-66d44c49ca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:43.464017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1007/1984] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:58:43.472247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7c5e-e46c-409e-84f1-d088f3b75249 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:43.472568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7c5e-e46c-409e-84f1-d088f3b75249 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:43.472783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7c5e-e46c-409e-84f1-d088f3b75249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:43.495853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3f0c7c5e-e46c-409e-84f1-d088f3b75249 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:43.497155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3f0c7c5e-e46c-409e-84f1-d088f3b75249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:43.511185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 978/1985] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:43.515915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4629a-395b-4b33-997b-66d44c49ca68 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:43.533791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4629a-395b-4b33-997b-66d44c49ca68 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:43.545100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caac15-0c85-4d58-af01-5757e211553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:43.546077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caac15-0c85-4d58-af01-5757e211553d admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:43.546547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caac15-0c85-4d58-af01-5757e211553d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:43.546972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caac15-0c85-4d58-af01-5757e211553d admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:43.547865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8caac15-0c85-4d58-af01-5757e211553d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:43.548180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8caac15-0c85-4d58-af01-5757e211553d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:43.550945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8caac15-0c85-4d58-af01-5757e211553d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:43.570999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1008/1986] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:43.575060 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7c5e-e46c-409e-84f1-d088f3b75249 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:43.588379 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7c5e-e46c-409e-84f1-d088f3b75249 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:43.595269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90604be4-7ce7-438d-a2af-829138621727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:43.596096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90604be4-7ce7-438d-a2af-829138621727 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:43.596383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90604be4-7ce7-438d-a2af-829138621727 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:43.596884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90604be4-7ce7-438d-a2af-829138621727 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:43.597585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90604be4-7ce7-438d-a2af-829138621727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:43.601155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90604be4-7ce7-438d-a2af-829138621727 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:43.832560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 979/1987] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:43 2022] POST /identity/v3/projects => generated 379 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:43.839582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caac15-0c85-4d58-af01-5757e211553d admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:43.853091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caac15-0c85-4d58-af01-5757e211553d admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:43.937227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616afda-ef4a-44e1-a6e9-4871304f204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:43.937911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616afda-ef4a-44e1-a6e9-4871304f204e admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:43.938197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616afda-ef4a-44e1-a6e9-4871304f204e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:43.938467 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616afda-ef4a-44e1-a6e9-4871304f204e admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:43.939091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616afda-ef4a-44e1-a6e9-4871304f204e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:43.941163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616afda-ef4a-44e1-a6e9-4871304f204e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:44.033038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90604be4-7ce7-438d-a2af-829138621727 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:44.035346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-90604be4-7ce7-438d-a2af-829138621727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:44.050518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90604be4-7ce7-438d-a2af-829138621727 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:44.065654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:44.065654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:44.065654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:44.065654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] PATH_INFO: `/v3/users/1692f7dd9fe544ad8632c800681d9f53` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:44.066136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1692f7dd9fe544ad8632c800681d9f53)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:44.066136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:44.130471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1009/1988] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:43 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:44.131752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616afda-ef4a-44e1-a6e9-4871304f204e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:44.143910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616afda-ef4a-44e1-a6e9-4871304f204e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:44.148655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88241624-feca-44d5-8889-ae8bc9d10375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:44.149438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88241624-feca-44d5-8889-ae8bc9d10375 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:44.149589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88241624-feca-44d5-8889-ae8bc9d10375 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:44.150019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88241624-feca-44d5-8889-ae8bc9d10375 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:44.150727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88241624-feca-44d5-8889-ae8bc9d10375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:44.152249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88241624-feca-44d5-8889-ae8bc9d10375 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:44.165292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1010/1989] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:58:44.169087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88241624-feca-44d5-8889-ae8bc9d10375 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:44.183799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88241624-feca-44d5-8889-ae8bc9d10375 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:44.189884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ecda9-e10e-4e90-bf9c-faf539ccc9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:44.190939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ecda9-e10e-4e90-bf9c-faf539ccc9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:44.193508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ecda9-e10e-4e90-bf9c-faf539ccc9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:44.193508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ecda9-e10e-4e90-bf9c-faf539ccc9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:44.193508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ecda9-e10e-4e90-bf9c-faf539ccc9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:44.195440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ecda9-e10e-4e90-bf9c-faf539ccc9d7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:44.216813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1011/1990] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:44.221438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ecda9-e10e-4e90-bf9c-faf539ccc9d7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:44.234201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ecda9-e10e-4e90-bf9c-faf539ccc9d7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:44.239685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0ad4e-46f7-419a-9457-abd58b12ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:44.240406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0ad4e-46f7-419a-9457-abd58b12ad85 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:44.240732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0ad4e-46f7-419a-9457-abd58b12ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:44.241012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0ad4e-46f7-419a-9457-abd58b12ad85 admin admin] PATH_INFO: `/v3/projects/502b67f1fdde460194c0da9621207526/users/b9424049f409475c847d7d55e716ae03/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:44.256975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0ad4e-46f7-419a-9457-abd58b12ad85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502b67f1fdde460194c0da9621207526, user_id=b9424049f409475c847d7d55e716ae03, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:44.259978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac0ad4e-46f7-419a-9457-abd58b12ad85 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:44.560316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:44.575733 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1012/1991] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:44 2022] PUT /identity/v3/projects/502b67f1fdde460194c0da9621207526/users/b9424049f409475c847d7d55e716ae03/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:44.586848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12512c21-3ae2-4fd6-9ffd-c2a6df0867f1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:44.587709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12512c21-3ae2-4fd6-9ffd-c2a6df0867f1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:44.588136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12512c21-3ae2-4fd6-9ffd-c2a6df0867f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:44.623753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-12512c21-3ae2-4fd6-9ffd-c2a6df0867f1 None None] MFA Rules not processed for user `b9424049f409475c847d7d55e716ae03`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:44.625055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-12512c21-3ae2-4fd6-9ffd-c2a6df0867f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:44.639320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1692f7dd9fe544ad8632c800681d9f53'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:44.655210 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1692f7dd9fe544ad8632c800681d9f53'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:44.696336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1013/1992] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:44.700977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12512c21-3ae2-4fd6-9ffd-c2a6df0867f1 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:44.767286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12512c21-3ae2-4fd6-9ffd-c2a6df0867f1 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:44.773793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba247ce8-869b-475f-ba46-d0023613fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:44.780593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba247ce8-869b-475f-ba46-d0023613fdc2 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:44.780593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba247ce8-869b-475f-ba46-d0023613fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:44.780593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba247ce8-869b-475f-ba46-d0023613fdc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:44.780593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba247ce8-869b-475f-ba46-d0023613fdc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:44.780593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba247ce8-869b-475f-ba46-d0023613fdc2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:44.913507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1692f7dd9fe544ad8632c800681d9f53'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:44.914166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1692f7dd9fe544ad8632c800681d9f53'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:44.937198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-53432179-a72f-4b04-bf0f-7fdbe25cb51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1692f7dd9fe544ad8632c800681d9f53'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:44.946796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 980/1993] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:44 2022] DELETE /identity/v3/users/1692f7dd9fe544ad8632c800681d9f53 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:44.951489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a4df2-6223-4b93-aeaf-ee324b8247aa None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:44.951931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a4df2-6223-4b93-aeaf-ee324b8247aa None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:44.952206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a4df2-6223-4b93-aeaf-ee324b8247aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:44.983048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b10a4df2-6223-4b93-aeaf-ee324b8247aa None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:44.984296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b10a4df2-6223-4b93-aeaf-ee324b8247aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:45.000063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1014/1994] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:44 2022] POST /identity/v3/projects => generated 379 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:45.001205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba247ce8-869b-475f-ba46-d0023613fdc2 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:45.003904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ba247ce8-869b-475f-ba46-d0023613fdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:45.050311 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 981/1995] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:45.060550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a4df2-6223-4b93-aeaf-ee324b8247aa None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:45.062093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b10a4df2-6223-4b93-aeaf-ee324b8247aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:45.075737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba247ce8-869b-475f-ba46-d0023613fdc2 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:45.081275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0cb1e-9617-406e-98c9-0355f9737ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:45.081657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0cb1e-9617-406e-98c9-0355f9737ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:45.082215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0cb1e-9617-406e-98c9-0355f9737ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:45.082581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0cb1e-9617-406e-98c9-0355f9737ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:45.083311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0cb1e-9617-406e-98c9-0355f9737ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:45.085474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0cb1e-9617-406e-98c9-0355f9737ed7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:45.122669 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a4df2-6223-4b93-aeaf-ee324b8247aa None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:45.175494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b2a68-107b-4696-9a93-6da82f29cb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:45.176109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b2a68-107b-4696-9a93-6da82f29cb54 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:45.176386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b2a68-107b-4696-9a93-6da82f29cb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:45.176735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b2a68-107b-4696-9a93-6da82f29cb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:45.186437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b2a68-107b-4696-9a93-6da82f29cb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:45.187897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b2a68-107b-4696-9a93-6da82f29cb54 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:45.198192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 982/1996] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:58:45.246404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1015/1997] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:45 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:45.252214 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b2a68-107b-4696-9a93-6da82f29cb54 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:45.264630 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b2a68-107b-4696-9a93-6da82f29cb54 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:45.277197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308e21-4817-4171-ae49-61e069da41d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:45.277971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308e21-4817-4171-ae49-61e069da41d4 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:45.278385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308e21-4817-4171-ae49-61e069da41d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:45.278725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f308e21-4817-4171-ae49-61e069da41d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:45.279481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308e21-4817-4171-ae49-61e069da41d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:45.281285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f308e21-4817-4171-ae49-61e069da41d4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:45.296461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 983/1998] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:45.300080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0cb1e-9617-406e-98c9-0355f9737ed7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:45.310460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0cb1e-9617-406e-98c9-0355f9737ed7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:45.316107 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afd1bb-81b5-4b14-8f74-a5b0cc9dfad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:45.316864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afd1bb-81b5-4b14-8f74-a5b0cc9dfad2 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:45.317219 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afd1bb-81b5-4b14-8f74-a5b0cc9dfad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:45.317586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afd1bb-81b5-4b14-8f74-a5b0cc9dfad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:45.318272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afd1bb-81b5-4b14-8f74-a5b0cc9dfad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:45.319892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afd1bb-81b5-4b14-8f74-a5b0cc9dfad2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:45.331588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1016/1999] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:45.336212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308e21-4817-4171-ae49-61e069da41d4 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:45.346720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f308e21-4817-4171-ae49-61e069da41d4 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:45.351391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d3774-e07b-413b-990d-15d7382673d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:45.352066 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d3774-e07b-413b-990d-15d7382673d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:45.352385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d3774-e07b-413b-990d-15d7382673d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:45.352715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d3774-e07b-413b-990d-15d7382673d3 admin admin] PATH_INFO: `/v3/projects/b7af9e5c4a7d4eb284b318db219ee92c/users/54e04412626343c9b6c9c69f67ecff00/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:45.368618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d3774-e07b-413b-990d-15d7382673d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7af9e5c4a7d4eb284b318db219ee92c, user_id=54e04412626343c9b6c9c69f67ecff00, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:45.371303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d3774-e07b-413b-990d-15d7382673d3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:45.527430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 984/2000] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:45 2022] PUT /identity/v3/projects/b7af9e5c4a7d4eb284b318db219ee92c/users/54e04412626343c9b6c9c69f67ecff00/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:45.539034 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f968-7af1-475e-b16b-dcda1560244a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:45.539394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f968-7af1-475e-b16b-dcda1560244a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:45.539613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f968-7af1-475e-b16b-dcda1560244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:45.572583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-7409f968-7af1-475e-b16b-dcda1560244a None None] MFA Rules not processed for user `54e04412626343c9b6c9c69f67ecff00`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:45.574469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7409f968-7af1-475e-b16b-dcda1560244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:45.646001 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1017/2001] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:45.650656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d3774-e07b-413b-990d-15d7382673d3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:45.719319 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d3774-e07b-413b-990d-15d7382673d3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:45.724503 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7324-9ca0-4d93-9c8e-9dd3e0e6b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:45.725209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7324-9ca0-4d93-9c8e-9dd3e0e6b8ce admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:45.725560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7324-9ca0-4d93-9c8e-9dd3e0e6b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:45.725839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7324-9ca0-4d93-9c8e-9dd3e0e6b8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:45.726474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d7324-9ca0-4d93-9c8e-9dd3e0e6b8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:45.728367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d7324-9ca0-4d93-9c8e-9dd3e0e6b8ce admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:45.870175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f968-7af1-475e-b16b-dcda1560244a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:45.871640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7409f968-7af1-475e-b16b-dcda1560244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:45.887166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f968-7af1-475e-b16b-dcda1560244a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:45.891815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:45.892556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:45.892830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:45.893101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] PATH_INFO: `/v3/projects/7ecc16adb5134e56ab67b9e803007b7d` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:45.894389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ecc16adb5134e56ab67b9e803007b7d)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:45.896399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:46.044744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 985/2002] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:45 2022] POST /identity/v3/projects => generated 379 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:46.048616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7324-9ca0-4d93-9c8e-9dd3e0e6b8ce admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:46.111117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7324-9ca0-4d93-9c8e-9dd3e0e6b8ce admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:46.116373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fbc67-9758-48f7-adba-ca178082cfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:46.117054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbc67-9758-48f7-adba-ca178082cfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.117349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbc67-9758-48f7-adba-ca178082cfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.117632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbc67-9758-48f7-adba-ca178082cfa3 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.118256 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fbc67-9758-48f7-adba-ca178082cfa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:46.120183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fbc67-9758-48f7-adba-ca178082cfa3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:46.290105 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecc16adb5134e56ab67b9e803007b7d', 'request_id': 'req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:46.297602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecc16adb5134e56ab67b9e803007b7d', 'request_id': 'req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:46.308088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecc16adb5134e56ab67b9e803007b7d', 'request_id': 'req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:46.441087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 986/2003] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:46 2022] POST /identity/v3/users => generated 296 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:46.444318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fbc67-9758-48f7-adba-ca178082cfa3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:46.454119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fbc67-9758-48f7-adba-ca178082cfa3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:46.510220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a6abd-1a35-4a5f-bcbb-69eb7ec58c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:46.510839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a6abd-1a35-4a5f-bcbb-69eb7ec58c11 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.511121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a6abd-1a35-4a5f-bcbb-69eb7ec58c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.511396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a6abd-1a35-4a5f-bcbb-69eb7ec58c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.512042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a6abd-1a35-4a5f-bcbb-69eb7ec58c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:46.513664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a6abd-1a35-4a5f-bcbb-69eb7ec58c11 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:46.523245 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 987/2004] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:46.527375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a6abd-1a35-4a5f-bcbb-69eb7ec58c11 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:46.537270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a6abd-1a35-4a5f-bcbb-69eb7ec58c11 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:46.541932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb050c-506c-4b53-9f99-c30537502df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:46.542580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb050c-506c-4b53-9f99-c30537502df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.544257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb050c-506c-4b53-9f99-c30537502df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.544257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb050c-506c-4b53-9f99-c30537502df8 admin admin] PATH_INFO: `/v3/projects/989e504f10a748f19a2913f549356b9d/users/62833242632e4e3d9ae3145e637588fa/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.559133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb050c-506c-4b53-9f99-c30537502df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989e504f10a748f19a2913f549356b9d, user_id=62833242632e4e3d9ae3145e637588fa, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:46.561888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb050c-506c-4b53-9f99-c30537502df8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:46.587629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] The token cache is being invalidate because project 7ecc16adb5134e56ab67b9e803007b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:46.587922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:46.588975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:46.595829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1018/2005] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:45 2022] DELETE /identity/v3/projects/7ecc16adb5134e56ab67b9e803007b7d => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:46.598537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:46.600295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:46.615964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc33c1-2c9c-4a6a-8b01-9a58659b7d49 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:46.621539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:46.622210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.622496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.622771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] PATH_INFO: `/v3/users/8541a5c194ea46dd940cb4e25c69b388` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.623959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8541a5c194ea46dd940cb4e25c69b388)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:46.625997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:46.707697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:46.776042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 988/2006] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:46 2022] PUT /identity/v3/projects/989e504f10a748f19a2913f549356b9d/users/62833242632e4e3d9ae3145e637588fa/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:46.779931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb050c-506c-4b53-9f99-c30537502df8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:46.781672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c0bb050c-506c-4b53-9f99-c30537502df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:46.844817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb050c-506c-4b53-9f99-c30537502df8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:46.850374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854d755-8d18-424b-85ab-ed299d008ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:46.850980 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854d755-8d18-424b-85ab-ed299d008ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.851259 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854d755-8d18-424b-85ab-ed299d008ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.851532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854d755-8d18-424b-85ab-ed299d008ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.852169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854d755-8d18-424b-85ab-ed299d008ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:46.853876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854d755-8d18-424b-85ab-ed299d008ae6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:46.864565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 989/2007] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:58:46.868911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854d755-8d18-424b-85ab-ed299d008ae6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:46.878580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854d755-8d18-424b-85ab-ed299d008ae6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:46.883489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54207b-eb2c-4f8c-9538-095bbd176b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:46.884145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54207b-eb2c-4f8c-9538-095bbd176b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.884421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54207b-eb2c-4f8c-9538-095bbd176b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.884771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54207b-eb2c-4f8c-9538-095bbd176b01 admin admin] PATH_INFO: `/v3/projects/989e504f10a748f19a2913f549356b9d/users/62833242632e4e3d9ae3145e637588fa/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.886770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54207b-eb2c-4f8c-9538-095bbd176b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989e504f10a748f19a2913f549356b9d, user_id=62833242632e4e3d9ae3145e637588fa, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:46.889617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54207b-eb2c-4f8c-9538-095bbd176b01 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:46.901542 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 990/2008] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:46 2022] PUT /identity/v3/projects/989e504f10a748f19a2913f549356b9d/users/62833242632e4e3d9ae3145e637588fa/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:46.912104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35df42-8cbc-4bf2-80ad-eac53ad08202 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.912386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35df42-8cbc-4bf2-80ad-eac53ad08202 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.912783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35df42-8cbc-4bf2-80ad-eac53ad08202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.943567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8b35df42-8cbc-4bf2-80ad-eac53ad08202 None None] MFA Rules not processed for user `62833242632e4e3d9ae3145e637588fa`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:46.944936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8b35df42-8cbc-4bf2-80ad-eac53ad08202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:47.013946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 991/2009] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:58:47.025119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35df42-8cbc-4bf2-80ad-eac53ad08202 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:47.026483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8b35df42-8cbc-4bf2-80ad-eac53ad08202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:47.084391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35df42-8cbc-4bf2-80ad-eac53ad08202 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:47.088138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21671fa-bb32-43d6-aaee-d509e6b98c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:47.088860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21671fa-bb32-43d6-aaee-d509e6b98c7a service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:47.089295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21671fa-bb32-43d6-aaee-d509e6b98c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:47.089571 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21671fa-bb32-43d6-aaee-d509e6b98c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:47.099837 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21671fa-bb32-43d6-aaee-d509e6b98c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:47.101713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21671fa-bb32-43d6-aaee-d509e6b98c7a service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:47.111621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 992/2010] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:58:47.209123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8541a5c194ea46dd940cb4e25c69b388'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:47.221355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8541a5c194ea46dd940cb4e25c69b388'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:47.376425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8541a5c194ea46dd940cb4e25c69b388'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:47.377159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8541a5c194ea46dd940cb4e25c69b388'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:47.377823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8541a5c194ea46dd940cb4e25c69b388'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:47.399332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1019/2011] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:46 2022] DELETE /identity/v3/users/8541a5c194ea46dd940cb4e25c69b388 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:47.404226 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21671fa-bb32-43d6-aaee-d509e6b98c7a service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:47.415068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21671fa-bb32-43d6-aaee-d509e6b98c7a service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:47.479977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f83c04-339e-4a29-ae95-90c3468f93ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:47.480864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83c04-339e-4a29-ae95-90c3468f93ab service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:47.481334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83c04-339e-4a29-ae95-90c3468f93ab service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:47.481636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83c04-339e-4a29-ae95-90c3468f93ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:47.483405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-42f83c04-339e-4a29-ae95-90c3468f93ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:47.733341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f83c04-339e-4a29-ae95-90c3468f93ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:47.734848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f83c04-339e-4a29-ae95-90c3468f93ab service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:47.743914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 993/2012] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:48.414944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:48.416658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:48.535807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aee29d-8926-40ac-85c2-35d68fd74eba admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:48.542865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:48.543847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:48.544430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:48.544801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] PATH_INFO: `/v3/projects/c51697181a7e4e778ff93020304f651a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:48.549527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51697181a7e4e778ff93020304f651a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:48.553564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:48.944185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51697181a7e4e778ff93020304f651a', 'request_id': 'req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:48.949773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51697181a7e4e778ff93020304f651a', 'request_id': 'req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:48.955914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51697181a7e4e778ff93020304f651a', 'request_id': 'req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:49.157020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] The token cache is being invalidate because project c51697181a7e4e778ff93020304f651a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:49.157220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:49.158139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4d8a4da4-447b-4ed7-98c4-6fff5ebe08f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:49.161965 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1020/2013] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:48 2022] DELETE /identity/v3/projects/c51697181a7e4e778ff93020304f651a => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:49.166925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9b09d-d29e-460a-915f-9c949e630584 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:49.167389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9b09d-d29e-460a-915f-9c949e630584 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:49.167480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9b09d-d29e-460a-915f-9c949e630584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:49.193339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8fc9b09d-d29e-460a-915f-9c949e630584 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:49.194760 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8fc9b09d-d29e-460a-915f-9c949e630584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:49.259717 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 994/2014] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:49.268214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684de1-041b-4a7e-b258-6171acf23235 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:49.268504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684de1-041b-4a7e-b258-6171acf23235 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:49.268801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3684de1-041b-4a7e-b258-6171acf23235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:49.295957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-f3684de1-041b-4a7e-b258-6171acf23235 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:49.297609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f3684de1-041b-4a7e-b258-6171acf23235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:49.307407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1021/2015] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:58:49.312859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9b09d-d29e-460a-915f-9c949e630584 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:49.325652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9b09d-d29e-460a-915f-9c949e630584 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:49.330596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84ec79-97c2-4b1d-bd9e-78ddd471e0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:49.331246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84ec79-97c2-4b1d-bd9e-78ddd471e0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:49.331528 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84ec79-97c2-4b1d-bd9e-78ddd471e0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:49.331803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84ec79-97c2-4b1d-bd9e-78ddd471e0b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:49.332455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84ec79-97c2-4b1d-bd9e-78ddd471e0b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:49.332794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84ec79-97c2-4b1d-bd9e-78ddd471e0b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:49.334467 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84ec79-97c2-4b1d-bd9e-78ddd471e0b8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:49.347519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 995/2016] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:49.351915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3684de1-041b-4a7e-b258-6171acf23235 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:49.361233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3684de1-041b-4a7e-b258-6171acf23235 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:49.366654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796977bf-895b-4860-8d8e-3316e0b9d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:49.367263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796977bf-895b-4860-8d8e-3316e0b9d483 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:49.367541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796977bf-895b-4860-8d8e-3316e0b9d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:49.371811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796977bf-895b-4860-8d8e-3316e0b9d483 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:49.371811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796977bf-895b-4860-8d8e-3316e0b9d483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:49.371811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796977bf-895b-4860-8d8e-3316e0b9d483 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:49.510325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1022/2017] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:49 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:49.511644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84ec79-97c2-4b1d-bd9e-78ddd471e0b8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:49.525517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84ec79-97c2-4b1d-bd9e-78ddd471e0b8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:49.670155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ae912-9185-4a8f-8157-bd4f3579fe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:49.671175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ae912-9185-4a8f-8157-bd4f3579fe9e admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:49.671450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ae912-9185-4a8f-8157-bd4f3579fe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:49.671729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ae912-9185-4a8f-8157-bd4f3579fe9e admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:49.672868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ae912-9185-4a8f-8157-bd4f3579fe9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:49.674955 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ae912-9185-4a8f-8157-bd4f3579fe9e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:49.868869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 996/2018] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:49 2022] POST /identity/v3/users => generated 291 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:58:49.872611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796977bf-895b-4860-8d8e-3316e0b9d483 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:49.883350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796977bf-895b-4860-8d8e-3316e0b9d483 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:49.888492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7d9d1-f8d3-4d4a-bb77-aa1f1b401ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:49.889158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7d9d1-f8d3-4d4a-bb77-aa1f1b401ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:49.889570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7d9d1-f8d3-4d4a-bb77-aa1f1b401ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:49.889948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7d9d1-f8d3-4d4a-bb77-aa1f1b401ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:49.890663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7d9d1-f8d3-4d4a-bb77-aa1f1b401ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:49.892374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7d9d1-f8d3-4d4a-bb77-aa1f1b401ae9 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:49.904247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1023/2019] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:49.908660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ae912-9185-4a8f-8157-bd4f3579fe9e admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:49.919350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ae912-9185-4a8f-8157-bd4f3579fe9e admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:49.927558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749f438-e107-4a7b-879d-71cdbbd5fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:49.928443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749f438-e107-4a7b-879d-71cdbbd5fb2a admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:49.928805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749f438-e107-4a7b-879d-71cdbbd5fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:49.929100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749f438-e107-4a7b-879d-71cdbbd5fb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:49.929803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749f438-e107-4a7b-879d-71cdbbd5fb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:49.931370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749f438-e107-4a7b-879d-71cdbbd5fb2a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:49.944258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 997/2020] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:58:49.953766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7d9d1-f8d3-4d4a-bb77-aa1f1b401ae9 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:49.966482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7d9d1-f8d3-4d4a-bb77-aa1f1b401ae9 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:49.974271 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776511e-b751-44a0-ade7-c59f92569bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:49.975141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776511e-b751-44a0-ade7-c59f92569bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:49.975436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776511e-b751-44a0-ade7-c59f92569bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:49.975696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776511e-b751-44a0-ade7-c59f92569bd0 admin admin] PATH_INFO: `/v3/projects/209cd23c05864b62920ddf9ca64b064e/users/f8a0083189ec473c89f9431ea46b6ccb/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:49.994793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776511e-b751-44a0-ade7-c59f92569bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209cd23c05864b62920ddf9ca64b064e, user_id=f8a0083189ec473c89f9431ea46b6ccb, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:49.998332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776511e-b751-44a0-ade7-c59f92569bd0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:50.173656 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1024/2021] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:49 2022] PUT /identity/v3/projects/209cd23c05864b62920ddf9ca64b064e/users/f8a0083189ec473c89f9431ea46b6ccb/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:50.183334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ced1e-e883-4be4-a8cb-c2b34c2269d6 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:50.183826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ced1e-e883-4be4-a8cb-c2b34c2269d6 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:50.183906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ced1e-e883-4be4-a8cb-c2b34c2269d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:50.235222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-5e8ced1e-e883-4be4-a8cb-c2b34c2269d6 None None] MFA Rules not processed for user `f8a0083189ec473c89f9431ea46b6ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:50.239858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5e8ced1e-e883-4be4-a8cb-c2b34c2269d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:50.344359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 998/2022] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:50.349071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776511e-b751-44a0-ade7-c59f92569bd0 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:50.412757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776511e-b751-44a0-ade7-c59f92569bd0 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:50.417759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a7e25-e27f-40b3-9c69-dcd72086317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:50.418379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a7e25-e27f-40b3-9c69-dcd72086317a admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:50.418660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a7e25-e27f-40b3-9c69-dcd72086317a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:50.418933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a7e25-e27f-40b3-9c69-dcd72086317a admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:50.422605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a7e25-e27f-40b3-9c69-dcd72086317a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:50.422605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a7e25-e27f-40b3-9c69-dcd72086317a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:50.560504 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1025/2023] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:50 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:50.562911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ced1e-e883-4be4-a8cb-c2b34c2269d6 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:50.577182 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ced1e-e883-4be4-a8cb-c2b34c2269d6 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:50.655361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95b3fd-8974-4529-969b-847a6f7140e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:50.656121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95b3fd-8974-4529-969b-847a6f7140e6 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:50.656268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95b3fd-8974-4529-969b-847a6f7140e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:50.656565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95b3fd-8974-4529-969b-847a6f7140e6 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:50.657218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95b3fd-8974-4529-969b-847a6f7140e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:50.660032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95b3fd-8974-4529-969b-847a6f7140e6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:50.834275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 999/2024] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:50 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:50.842842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a7e25-e27f-40b3-9c69-dcd72086317a admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:50.856589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a7e25-e27f-40b3-9c69-dcd72086317a admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:50.865764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3f60-b7b8-46f7-98a1-6cf7297e9cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:50.866823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3f60-b7b8-46f7-98a1-6cf7297e9cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:50.867193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3f60-b7b8-46f7-98a1-6cf7297e9cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:50.867722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d3f60-b7b8-46f7-98a1-6cf7297e9cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:50.868685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d3f60-b7b8-46f7-98a1-6cf7297e9cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:50.870648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d3f60-b7b8-46f7-98a1-6cf7297e9cb8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:50.884340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1026/2025] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:50.888723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95b3fd-8974-4529-969b-847a6f7140e6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:50.900910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95b3fd-8974-4529-969b-847a6f7140e6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:50.907995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62caa66-5f70-4ddd-a534-07825cb6903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:50.908940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62caa66-5f70-4ddd-a534-07825cb6903c admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:50.909821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62caa66-5f70-4ddd-a534-07825cb6903c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:50.910734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62caa66-5f70-4ddd-a534-07825cb6903c admin admin] PATH_INFO: `/v3/projects/2afef4c9871e455eb87a8ccf9359ccbc/users/9ccdfc8aa1564b52ab0d8e21790a2a80/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:50.927635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62caa66-5f70-4ddd-a534-07825cb6903c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afef4c9871e455eb87a8ccf9359ccbc, user_id=9ccdfc8aa1564b52ab0d8e21790a2a80, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:50.930742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62caa66-5f70-4ddd-a534-07825cb6903c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:51.044268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1000/2026] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:50 2022] PUT /identity/v3/projects/2afef4c9871e455eb87a8ccf9359ccbc/users/9ccdfc8aa1564b52ab0d8e21790a2a80/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:51.045341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3f60-b7b8-46f7-98a1-6cf7297e9cb8 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:51.060216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d3f60-b7b8-46f7-98a1-6cf7297e9cb8 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:51.128616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6f4c-4326-4bd6-8a00-6b9d9b26a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:51.129245 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6f4c-4326-4bd6-8a00-6b9d9b26a302 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:51.129532 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6f4c-4326-4bd6-8a00-6b9d9b26a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:51.129807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6f4c-4326-4bd6-8a00-6b9d9b26a302 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:51.134150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6f4c-4326-4bd6-8a00-6b9d9b26a302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:51.134150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6f4c-4326-4bd6-8a00-6b9d9b26a302 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:51.144268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1027/2027] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:51.149045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62caa66-5f70-4ddd-a534-07825cb6903c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:51.161383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62caa66-5f70-4ddd-a534-07825cb6903c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:51.176118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb1d67-5ea5-46f7-91e0-869f2c8db253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:51.178127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb1d67-5ea5-46f7-91e0-869f2c8db253 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:51.178127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb1d67-5ea5-46f7-91e0-869f2c8db253 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:51.178127 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb1d67-5ea5-46f7-91e0-869f2c8db253 admin admin] PATH_INFO: `/v3/projects/2afef4c9871e455eb87a8ccf9359ccbc/users/9ccdfc8aa1564b52ab0d8e21790a2a80/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:51.180655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb1d67-5ea5-46f7-91e0-869f2c8db253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afef4c9871e455eb87a8ccf9359ccbc, user_id=9ccdfc8aa1564b52ab0d8e21790a2a80, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:51.183430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb1d67-5ea5-46f7-91e0-869f2c8db253 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:51.195415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1001/2028] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:51 2022] PUT /identity/v3/projects/2afef4c9871e455eb87a8ccf9359ccbc/users/9ccdfc8aa1564b52ab0d8e21790a2a80/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:51.210264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67cc74-38b8-4631-84f4-c0d52cd80b5b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:51.210553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67cc74-38b8-4631-84f4-c0d52cd80b5b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:51.210878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67cc74-38b8-4631-84f4-c0d52cd80b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:51.287582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-fc67cc74-38b8-4631-84f4-c0d52cd80b5b None None] MFA Rules not processed for user `9ccdfc8aa1564b52ab0d8e21790a2a80`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:51.288957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fc67cc74-38b8-4631-84f4-c0d52cd80b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:51.384883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1028/2029] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:51.396949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb1d67-5ea5-46f7-91e0-869f2c8db253 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:51.402509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bfcb1d67-5ea5-46f7-91e0-869f2c8db253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:51.466853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb1d67-5ea5-46f7-91e0-869f2c8db253 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:51.470773 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4156950-a7f6-47f4-90de-9d2f577728fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:51.471524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156950-a7f6-47f4-90de-9d2f577728fc service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:51.472166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156950-a7f6-47f4-90de-9d2f577728fc service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:51.472755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156950-a7f6-47f4-90de-9d2f577728fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:51.539246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4156950-a7f6-47f4-90de-9d2f577728fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:51.540735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4156950-a7f6-47f4-90de-9d2f577728fc service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:51.550091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1002/2030] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:51.737898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:52.456879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:53.916885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67cc74-38b8-4631-84f4-c0d52cd80b5b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:53.928636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fc67cc74-38b8-4631-84f4-c0d52cd80b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:54.015233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67cc74-38b8-4631-84f4-c0d52cd80b5b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:54.021579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:54.021579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:54.021851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:54.022332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] PATH_INFO: `/v3/users/b9424049f409475c847d7d55e716ae03` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:54.023625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9424049f409475c847d7d55e716ae03)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:54.025956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:54.396345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9424049f409475c847d7d55e716ae03'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:54.403286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9424049f409475c847d7d55e716ae03'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:54.559268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9424049f409475c847d7d55e716ae03'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:54.559894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9424049f409475c847d7d55e716ae03'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:54.561132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9424049f409475c847d7d55e716ae03'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:54.581680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1029/2031] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:53 2022] DELETE /identity/v3/users/b9424049f409475c847d7d55e716ae03 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:58:54.586364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915d792-6fc6-44d8-a402-793e8ceb18db None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:54.586869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915d792-6fc6-44d8-a402-793e8ceb18db None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:54.586961 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915d792-6fc6-44d8-a402-793e8ceb18db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:54.606497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d915d792-6fc6-44d8-a402-793e8ceb18db None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:54.607876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d915d792-6fc6-44d8-a402-793e8ceb18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:54.673734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1003/2032] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:54.684626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:54.686139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:54.761670 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fea02-76d0-428c-a083-f7dcfcd1d347 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:54.765478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3bbbd-fc83-42b6-9e9b-aaa18bc98a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:54.766165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3bbbd-fc83-42b6-9e9b-aaa18bc98a7d service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:54.766512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3bbbd-fc83-42b6-9e9b-aaa18bc98a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:54.766857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3bbbd-fc83-42b6-9e9b-aaa18bc98a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:54.786247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3bbbd-fc83-42b6-9e9b-aaa18bc98a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:54.786247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3bbbd-fc83-42b6-9e9b-aaa18bc98a7d service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:54.788888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1030/2033] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:55.395439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915d792-6fc6-44d8-a402-793e8ceb18db None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:55.396883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d915d792-6fc6-44d8-a402-793e8ceb18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:55.411378 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915d792-6fc6-44d8-a402-793e8ceb18db None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:55.416225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:55.419557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:55.419557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:55.419557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] PATH_INFO: `/v3/projects/502b67f1fdde460194c0da9621207526` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:55.419557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502b67f1fdde460194c0da9621207526)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:55.420706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:55.582549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502b67f1fdde460194c0da9621207526', 'request_id': 'req-92158eef-c127-4434-ae37-f13e9b0a1198'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:55.713112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502b67f1fdde460194c0da9621207526', 'request_id': 'req-92158eef-c127-4434-ae37-f13e9b0a1198'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:55.720582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502b67f1fdde460194c0da9621207526', 'request_id': 'req-92158eef-c127-4434-ae37-f13e9b0a1198'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:55.733581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] The token cache is being invalidate because project 502b67f1fdde460194c0da9621207526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:55.733894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:55.735633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:55.737376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1004/2034] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:55 2022] DELETE /identity/v3/projects/502b67f1fdde460194c0da9621207526 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:55.741693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3bbbd-fc83-42b6-9e9b-aaa18bc98a7d service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:55.754673 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3bbbd-fc83-42b6-9e9b-aaa18bc98a7d service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:55.813543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:55.814170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:55.814451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:55.814722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] PATH_INFO: `/v3/users/54e04412626343c9b6c9c69f67ecff00` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:55.816489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e04412626343c9b6c9c69f67ecff00)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:55.818458 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:56.138800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e04412626343c9b6c9c69f67ecff00'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:56.147654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e04412626343c9b6c9c69f67ecff00'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:56.337223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e04412626343c9b6c9c69f67ecff00'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:56.338159 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e04412626343c9b6c9c69f67ecff00'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:56.339197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e04412626343c9b6c9c69f67ecff00'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:56.363598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1031/2035] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:55 2022] DELETE /identity/v3/users/54e04412626343c9b6c9c69f67ecff00 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:57.109603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:57.111051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:57.132405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92158eef-c127-4434-ae37-f13e9b0a1198 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:57.231472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:57.232361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:57.232848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:57.234205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] PATH_INFO: `/v3/projects/b7af9e5c4a7d4eb284b318db219ee92c` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:57.234689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7af9e5c4a7d4eb284b318db219ee92c)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:57.238272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:57.426778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7af9e5c4a7d4eb284b318db219ee92c', 'request_id': 'req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:57.508795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:57.522029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7af9e5c4a7d4eb284b318db219ee92c', 'request_id': 'req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:57.528335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7af9e5c4a7d4eb284b318db219ee92c', 'request_id': 'req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:57.540263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] The token cache is being invalidate because project b7af9e5c4a7d4eb284b318db219ee92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:57.540609 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:57.541375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:57.543046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1005/2036] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:57 2022] DELETE /identity/v3/projects/b7af9e5c4a7d4eb284b318db219ee92c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:57.547316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:57.548786 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:57.562973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75bbe5-5d15-4d87-8c82-809fb40818b0 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:57.621920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:57.622563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:57.623149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:57.623623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] PATH_INFO: `/v3/users/62833242632e4e3d9ae3145e637588fa` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:57.624940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62833242632e4e3d9ae3145e637588fa)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:57.626959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:57.985353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62833242632e4e3d9ae3145e637588fa'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:57.992417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62833242632e4e3d9ae3145e637588fa'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:58.096578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62833242632e4e3d9ae3145e637588fa'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:58.097219 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62833242632e4e3d9ae3145e637588fa'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:58.097829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62833242632e4e3d9ae3145e637588fa'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:58.115704 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1032/2037] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:57 2022] DELETE /identity/v3/users/62833242632e4e3d9ae3145e637588fa => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:58.512044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:58.517696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:58.604453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f116f-58a6-44a2-b675-f2f9aeebdb0f admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:58.682955 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812d3c9-eb2f-42e5-aa82-d485244cb8e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:58.683587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812d3c9-eb2f-42e5-aa82-d485244cb8e8 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:58.683872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812d3c9-eb2f-42e5-aa82-d485244cb8e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:58.684166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812d3c9-eb2f-42e5-aa82-d485244cb8e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:58.686819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5812d3c9-eb2f-42e5-aa82-d485244cb8e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:58.742470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:58.803028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812d3c9-eb2f-42e5-aa82-d485244cb8e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:58.805925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812d3c9-eb2f-42e5-aa82-d485244cb8e8 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:58.823770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1006/2038] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:58.869525 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:58.872299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:58.977821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d672b-1302-4351-86cd-6d48abe8cd82 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:58.982735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:58.983305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:58.983579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:58.983872 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] PATH_INFO: `/v3/projects/989e504f10a748f19a2913f549356b9d` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:58.985021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989e504f10a748f19a2913f549356b9d)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:58.989233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:59.128601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989e504f10a748f19a2913f549356b9d', 'request_id': 'req-1220b4d3-6032-47f0-8a35-b1edf7b427e6'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:59.135310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989e504f10a748f19a2913f549356b9d', 'request_id': 'req-1220b4d3-6032-47f0-8a35-b1edf7b427e6'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:59.141662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989e504f10a748f19a2913f549356b9d', 'request_id': 'req-1220b4d3-6032-47f0-8a35-b1edf7b427e6'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:59.400069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] The token cache is being invalidate because project 989e504f10a748f19a2913f549356b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:59.400342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:59.401034 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1220b4d3-6032-47f0-8a35-b1edf7b427e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:59.404084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1033/2039] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:58 2022] DELETE /identity/v3/projects/989e504f10a748f19a2913f549356b9d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:59.411379 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470109b0-c75e-4d82-8b3d-1ec6a7184adb None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:59.412089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470109b0-c75e-4d82-8b3d-1ec6a7184adb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:59.412089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470109b0-c75e-4d82-8b3d-1ec6a7184adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:59.446194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-470109b0-c75e-4d82-8b3d-1ec6a7184adb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:59.447412 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-470109b0-c75e-4d82-8b3d-1ec6a7184adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:59.516839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1007/2040] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:59.526975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8618f-7f9d-4ba6-b26b-34351f669e2e None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:59.527259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8618f-7f9d-4ba6-b26b-34351f669e2e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:59.527531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8618f-7f9d-4ba6-b26b-34351f669e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:59.548157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-dfe8618f-7f9d-4ba6-b26b-34351f669e2e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:59.553098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-dfe8618f-7f9d-4ba6-b26b-34351f669e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:59.560174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1034/2041] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:59.564667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470109b0-c75e-4d82-8b3d-1ec6a7184adb None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:59.576121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470109b0-c75e-4d82-8b3d-1ec6a7184adb None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:59.581716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e1e4-f556-4f27-adae-a6b20fb4c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:59.582328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e1e4-f556-4f27-adae-a6b20fb4c191 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:59.582604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e1e4-f556-4f27-adae-a6b20fb4c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:59.582874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e1e4-f556-4f27-adae-a6b20fb4c191 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:59.583516 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861e1e4-f556-4f27-adae-a6b20fb4c191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:59.583817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861e1e4-f556-4f27-adae-a6b20fb4c191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:59.585451 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861e1e4-f556-4f27-adae-a6b20fb4c191 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:59.614693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1008/2042] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:59.615488 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8618f-7f9d-4ba6-b26b-34351f669e2e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:59.629531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8618f-7f9d-4ba6-b26b-34351f669e2e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:59.635312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702a03-8f5d-4a61-b2b2-36f4a64578e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:59.635576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702a03-8f5d-4a61-b2b2-36f4a64578e3 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:59.639701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702a03-8f5d-4a61-b2b2-36f4a64578e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:59.639701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08702a03-8f5d-4a61-b2b2-36f4a64578e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:59.639701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08702a03-8f5d-4a61-b2b2-36f4a64578e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:59.639701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08702a03-8f5d-4a61-b2b2-36f4a64578e3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:59.763146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1035/2043] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:59 2022] POST /identity/v3/projects => generated 361 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:59.767516 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e1e4-f556-4f27-adae-a6b20fb4c191 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:59.781957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e1e4-f556-4f27-adae-a6b20fb4c191 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:59.854516 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683aa5d-6304-42ca-a947-3ac1a7b79097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:59.855291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683aa5d-6304-42ca-a947-3ac1a7b79097 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:59.855634 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683aa5d-6304-42ca-a947-3ac1a7b79097 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:59.855997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683aa5d-6304-42ca-a947-3ac1a7b79097 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:59.857069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683aa5d-6304-42ca-a947-3ac1a7b79097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:59.859134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683aa5d-6304-42ca-a947-3ac1a7b79097 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:00.230414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1009/2044] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:59 2022] POST /identity/v3/users => generated 281 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:59:00.237523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702a03-8f5d-4a61-b2b2-36f4a64578e3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:00.248264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08702a03-8f5d-4a61-b2b2-36f4a64578e3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:00.253987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd04f41-0db3-487f-b69f-fb42e3b3320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:00.254892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04f41-0db3-487f-b69f-fb42e3b3320d admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:00.255319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04f41-0db3-487f-b69f-fb42e3b3320d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:00.255751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd04f41-0db3-487f-b69f-fb42e3b3320d admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:00.256621 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd04f41-0db3-487f-b69f-fb42e3b3320d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:00.258773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd04f41-0db3-487f-b69f-fb42e3b3320d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:00.269958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1036/2045] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:00.274049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683aa5d-6304-42ca-a947-3ac1a7b79097 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:00.287208 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683aa5d-6304-42ca-a947-3ac1a7b79097 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:00.292142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b94d1-da8c-42e0-bdf4-01c5adc0f809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:00.292929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b94d1-da8c-42e0-bdf4-01c5adc0f809 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:00.293315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b94d1-da8c-42e0-bdf4-01c5adc0f809 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:00.293648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b94d1-da8c-42e0-bdf4-01c5adc0f809 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:00.294509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b94d1-da8c-42e0-bdf4-01c5adc0f809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:00.296188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b94d1-da8c-42e0-bdf4-01c5adc0f809 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:00.309601 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1010/2046] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:00.313787 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd04f41-0db3-487f-b69f-fb42e3b3320d admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:00.325752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd04f41-0db3-487f-b69f-fb42e3b3320d admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:00.331900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189756-04b4-4624-bca8-147af184730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:00.331900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189756-04b4-4624-bca8-147af184730e admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:00.332125 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189756-04b4-4624-bca8-147af184730e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:00.332830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189756-04b4-4624-bca8-147af184730e admin admin] PATH_INFO: `/v3/projects/6c8d1aa94ef64f5698f015e81adb6a54/users/8de4ff3a3ccb409cabcb5fe7d9cc2004/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:00.352857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189756-04b4-4624-bca8-147af184730e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8d1aa94ef64f5698f015e81adb6a54, user_id=8de4ff3a3ccb409cabcb5fe7d9cc2004, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:00.355447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189756-04b4-4624-bca8-147af184730e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:00.656287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1037/2047] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:59:00 2022] PUT /identity/v3/projects/6c8d1aa94ef64f5698f015e81adb6a54/users/8de4ff3a3ccb409cabcb5fe7d9cc2004/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:59:00.669123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d35580-f72c-431f-8536-71d6c58a5700 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:00.669539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d35580-f72c-431f-8536-71d6c58a5700 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:00.669668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d35580-f72c-431f-8536-71d6c58a5700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:00.723106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e2d35580-f72c-431f-8536-71d6c58a5700 None None] MFA Rules not processed for user `8de4ff3a3ccb409cabcb5fe7d9cc2004`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:00.724754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e2d35580-f72c-431f-8536-71d6c58a5700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:00.800446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1011/2048] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:00.835821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189756-04b4-4624-bca8-147af184730e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:00.837634 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e2189756-04b4-4624-bca8-147af184730e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:00.897975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189756-04b4-4624-bca8-147af184730e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:00.903145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead4833-e3ff-4216-be6c-4fb0f43af8c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:00.904166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4833-e3ff-4216-be6c-4fb0f43af8c6 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:00.904719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4833-e3ff-4216-be6c-4fb0f43af8c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:00.905385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4833-e3ff-4216-be6c-4fb0f43af8c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:00.916223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead4833-e3ff-4216-be6c-4fb0f43af8c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:00.917920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead4833-e3ff-4216-be6c-4fb0f43af8c6 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:00.928312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1038/2049] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:01.160655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d35580-f72c-431f-8536-71d6c58a5700 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:01.160655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d35580-f72c-431f-8536-71d6c58a5700 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:01.160655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:01.160655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:01.162055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:01.162055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] PATH_INFO: `/v3/users/8de4ff3a3ccb409cabcb5fe7d9cc2004` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:01.162055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de4ff3a3ccb409cabcb5fe7d9cc2004)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:01.162055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:01.564815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38951-b324-444e-8030-685101eb7690 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:01.566021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38951-b324-444e-8030-685101eb7690 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:01.566261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb38951-b324-444e-8030-685101eb7690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:01.585368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-7eb38951-b324-444e-8030-685101eb7690 None None] MFA Rules not processed for user `1e513898018544c7924d592c40f7dd54`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:01.596925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7eb38951-b324-444e-8030-685101eb7690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:01.644661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1039/2050] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:59:01.683485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de4ff3a3ccb409cabcb5fe7d9cc2004'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:01.706529 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de4ff3a3ccb409cabcb5fe7d9cc2004'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:01.831610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de4ff3a3ccb409cabcb5fe7d9cc2004'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:01.832658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de4ff3a3ccb409cabcb5fe7d9cc2004'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:01.841570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de4ff3a3ccb409cabcb5fe7d9cc2004'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:01.847855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1012/2051] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:59:00 2022] DELETE /identity/v3/users/8de4ff3a3ccb409cabcb5fe7d9cc2004 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:01.852342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba63c-8440-4187-b337-4f2eda24c585 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:01.852723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba63c-8440-4187-b337-4f2eda24c585 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:01.852997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba63c-8440-4187-b337-4f2eda24c585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:01.873272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-84eba63c-8440-4187-b337-4f2eda24c585 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:01.874590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-84eba63c-8440-4187-b337-4f2eda24c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:01.955018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1040/2052] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:01.963311 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:01.965987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:02.033174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2c95-7ada-4d2e-bc41-5896be794db6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:02.038002 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e003fd-ebab-4e02-ac0e-449a88127897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:02.038968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e003fd-ebab-4e02-ac0e-449a88127897 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:02.039310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e003fd-ebab-4e02-ac0e-449a88127897 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:02.039509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e003fd-ebab-4e02-ac0e-449a88127897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:02.051008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e003fd-ebab-4e02-ac0e-449a88127897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:02.052717 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e003fd-ebab-4e02-ac0e-449a88127897 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:02.065628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1013/2053] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:02.620297 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eba63c-8440-4187-b337-4f2eda24c585 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:02.622535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-84eba63c-8440-4187-b337-4f2eda24c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:02.636558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eba63c-8440-4187-b337-4f2eda24c585 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:02.641874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:02.642560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:02.643073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:02.643538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] PATH_INFO: `/v3/projects/6c8d1aa94ef64f5698f015e81adb6a54` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:02.645116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8d1aa94ef64f5698f015e81adb6a54)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:02.647829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:02.857869 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8d1aa94ef64f5698f015e81adb6a54', 'request_id': 'req-981ce392-c8fe-4e74-9921-3138f6427638'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:02.866236 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8d1aa94ef64f5698f015e81adb6a54', 'request_id': 'req-981ce392-c8fe-4e74-9921-3138f6427638'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:02.872755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8d1aa94ef64f5698f015e81adb6a54', 'request_id': 'req-981ce392-c8fe-4e74-9921-3138f6427638'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:03.002956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] The token cache is being invalidate because project 6c8d1aa94ef64f5698f015e81adb6a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:59:03.005182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:03.005182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-981ce392-c8fe-4e74-9921-3138f6427638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:03.006073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1041/2054] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:59:02 2022] DELETE /identity/v3/projects/6c8d1aa94ef64f5698f015e81adb6a54 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:03.010830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46992ef-b820-49db-8658-1a197bcbcb0b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:03.011320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46992ef-b820-49db-8658-1a197bcbcb0b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:03.011399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46992ef-b820-49db-8658-1a197bcbcb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:03.032426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a46992ef-b820-49db-8658-1a197bcbcb0b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:03.034504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a46992ef-b820-49db-8658-1a197bcbcb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:03.112845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1014/2055] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:03.122877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49fec-cbd2-4648-8af3-96acd5aa4fe0 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:03.123666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49fec-cbd2-4648-8af3-96acd5aa4fe0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:03.124113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49fec-cbd2-4648-8af3-96acd5aa4fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:03.147991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-7be49fec-cbd2-4648-8af3-96acd5aa4fe0 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:03.149247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7be49fec-cbd2-4648-8af3-96acd5aa4fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:03.160500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1042/2056] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:03.166789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46992ef-b820-49db-8658-1a197bcbcb0b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:03.176979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46992ef-b820-49db-8658-1a197bcbcb0b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:03.181806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dc872-1129-4a30-82e4-1e7d920755a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:03.182405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc872-1129-4a30-82e4-1e7d920755a3 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:03.182682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc872-1129-4a30-82e4-1e7d920755a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:03.182952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc872-1129-4a30-82e4-1e7d920755a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:03.183594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dc872-1129-4a30-82e4-1e7d920755a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:59:03.183896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dc872-1129-4a30-82e4-1e7d920755a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:03.185623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dc872-1129-4a30-82e4-1e7d920755a3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:03.198299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1015/2057] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:59:03.203054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49fec-cbd2-4648-8af3-96acd5aa4fe0 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:03.213062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49fec-cbd2-4648-8af3-96acd5aa4fe0 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:03.217971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66ba8a-c6f0-43ac-82a4-396438f26bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:03.218572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66ba8a-c6f0-43ac-82a4-396438f26bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:03.218850 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66ba8a-c6f0-43ac-82a4-396438f26bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:03.219118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66ba8a-c6f0-43ac-82a4-396438f26bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:03.219755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66ba8a-c6f0-43ac-82a4-396438f26bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:03.222424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66ba8a-c6f0-43ac-82a4-396438f26bc1 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:03.460041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1043/2058] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:59:03 2022] POST /identity/v3/projects => generated 375 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:59:03.463798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dc872-1129-4a30-82e4-1e7d920755a3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:03.474805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dc872-1129-4a30-82e4-1e7d920755a3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:03.546100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05267652-6e13-4c59-acc6-69487c3edf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:03.546814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05267652-6e13-4c59-acc6-69487c3edf82 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:03.547186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05267652-6e13-4c59-acc6-69487c3edf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:03.547443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05267652-6e13-4c59-acc6-69487c3edf82 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:03.548098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05267652-6e13-4c59-acc6-69487c3edf82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:03.550096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05267652-6e13-4c59-acc6-69487c3edf82 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:03.743375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1016/2059] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:59:03 2022] POST /identity/v3/users => generated 288 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:59:03.747602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66ba8a-c6f0-43ac-82a4-396438f26bc1 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:03.758667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66ba8a-c6f0-43ac-82a4-396438f26bc1 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:03.763239 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300d44d-9eba-4a6f-b0e8-47ee187a42b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:03.763844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d44d-9eba-4a6f-b0e8-47ee187a42b8 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:03.764143 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d44d-9eba-4a6f-b0e8-47ee187a42b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:03.764419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d44d-9eba-4a6f-b0e8-47ee187a42b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:03.765098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300d44d-9eba-4a6f-b0e8-47ee187a42b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:03.766699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300d44d-9eba-4a6f-b0e8-47ee187a42b8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:03.777725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1044/2060] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:59:03.781867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05267652-6e13-4c59-acc6-69487c3edf82 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:03.793917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05267652-6e13-4c59-acc6-69487c3edf82 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:03.798802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51bd53-081b-4aa7-af91-65cd2ece4439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:03.801287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51bd53-081b-4aa7-af91-65cd2ece4439 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:03.801287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51bd53-081b-4aa7-af91-65cd2ece4439 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:03.801287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51bd53-081b-4aa7-af91-65cd2ece4439 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:03.801287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51bd53-081b-4aa7-af91-65cd2ece4439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:03.802739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51bd53-081b-4aa7-af91-65cd2ece4439 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:03.817086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1017/2061] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:03.818263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300d44d-9eba-4a6f-b0e8-47ee187a42b8 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:03.828477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300d44d-9eba-4a6f-b0e8-47ee187a42b8 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:03.834318 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbad541-d1b8-4fdd-b438-324f2f4e274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:03.835021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad541-d1b8-4fdd-b438-324f2f4e274e admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:03.835303 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad541-d1b8-4fdd-b438-324f2f4e274e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:03.835577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad541-d1b8-4fdd-b438-324f2f4e274e admin admin] PATH_INFO: `/v3/projects/cabb833e27614b92af8a49aa82c3fd19/users/1f6b88d1b4d6488dbcbfbd7407447b89/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:03.850851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbad541-d1b8-4fdd-b438-324f2f4e274e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabb833e27614b92af8a49aa82c3fd19, user_id=1f6b88d1b4d6488dbcbfbd7407447b89, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:03.853742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbad541-d1b8-4fdd-b438-324f2f4e274e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:04.028649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1045/2062] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:59:03 2022] PUT /identity/v3/projects/cabb833e27614b92af8a49aa82c3fd19/users/1f6b88d1b4d6488dbcbfbd7407447b89/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:04.040391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd27708-bd52-4e38-abc6-e7afcbc1a6f5 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:04.040987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd27708-bd52-4e38-abc6-e7afcbc1a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:04.041078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd27708-bd52-4e38-abc6-e7afcbc1a6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:04.075882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-9dd27708-bd52-4e38-abc6-e7afcbc1a6f5 None None] MFA Rules not processed for user `1f6b88d1b4d6488dbcbfbd7407447b89`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:04.077299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9dd27708-bd52-4e38-abc6-e7afcbc1a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:04.204716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1018/2063] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:04.237685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbad541-d1b8-4fdd-b438-324f2f4e274e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:04.239497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7dbad541-d1b8-4fdd-b438-324f2f4e274e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:04.299078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbad541-d1b8-4fdd-b438-324f2f4e274e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:04.303182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d06e55-59a3-4751-856c-fdf9d5db8a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:04.304047 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06e55-59a3-4751-856c-fdf9d5db8a8a service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:04.304433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06e55-59a3-4751-856c-fdf9d5db8a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:04.304694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06e55-59a3-4751-856c-fdf9d5db8a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:04.313471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d06e55-59a3-4751-856c-fdf9d5db8a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:04.315449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d06e55-59a3-4751-856c-fdf9d5db8a8a service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:04.324471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1046/2064] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:59:05.182218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:06.655522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:06.968738 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd27708-bd52-4e38-abc6-e7afcbc1a6f5 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:06.970368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9dd27708-bd52-4e38-abc6-e7afcbc1a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:07.042911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd27708-bd52-4e38-abc6-e7afcbc1a6f5 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:07.048115 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:07.048792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:07.049076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:07.049352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] PATH_INFO: `/v3/users/f8a0083189ec473c89f9431ea46b6ccb` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:07.051293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a0083189ec473c89f9431ea46b6ccb)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:07.053165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:07.352206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a0083189ec473c89f9431ea46b6ccb'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:07.369991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a0083189ec473c89f9431ea46b6ccb'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:07.524829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a0083189ec473c89f9431ea46b6ccb'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:07.525393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a0083189ec473c89f9431ea46b6ccb'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:07.532919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a0083189ec473c89f9431ea46b6ccb'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:07.538819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1019/2065] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:59:06 2022] DELETE /identity/v3/users/f8a0083189ec473c89f9431ea46b6ccb => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:07.543213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa1834-44b6-49a6-a0bc-905aa6b22afe None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:07.543499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa1834-44b6-49a6-a0bc-905aa6b22afe None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:07.543771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa1834-44b6-49a6-a0bc-905aa6b22afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:07.564252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d1fa1834-44b6-49a6-a0bc-905aa6b22afe None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:07.566076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d1fa1834-44b6-49a6-a0bc-905aa6b22afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:07.625325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1047/2066] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:07.640374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:07.641870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:07.700869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c531e-8ab6-466b-9371-a64d0db8d206 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:07.704449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473575-7d75-4f29-a5d9-97c333549154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:07.705108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473575-7d75-4f29-a5d9-97c333549154 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:07.705379 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473575-7d75-4f29-a5d9-97c333549154 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:07.705715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473575-7d75-4f29-a5d9-97c333549154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:07.714799 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7473575-7d75-4f29-a5d9-97c333549154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:07.722936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7473575-7d75-4f29-a5d9-97c333549154 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:07.726307 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1020/2067] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:07.976965 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:08.718776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa1834-44b6-49a6-a0bc-905aa6b22afe None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:08.719598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d1fa1834-44b6-49a6-a0bc-905aa6b22afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:08.733015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa1834-44b6-49a6-a0bc-905aa6b22afe None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:08.739072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:08.740040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:08.740605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:08.744958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] PATH_INFO: `/v3/projects/209cd23c05864b62920ddf9ca64b064e` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:08.744958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209cd23c05864b62920ddf9ca64b064e)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:08.744958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:08.894147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209cd23c05864b62920ddf9ca64b064e', 'request_id': 'req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:08.899633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209cd23c05864b62920ddf9ca64b064e', 'request_id': 'req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:08.906296 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209cd23c05864b62920ddf9ca64b064e', 'request_id': 'req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:09.016796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] The token cache is being invalidate because project 209cd23c05864b62920ddf9ca64b064e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:59:09.017117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:09.017812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:09.025536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1048/2068] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:59:08 2022] DELETE /identity/v3/projects/209cd23c05864b62920ddf9ca64b064e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:09.028408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473575-7d75-4f29-a5d9-97c333549154 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:09.038839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473575-7d75-4f29-a5d9-97c333549154 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:09.100609 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:09.101171 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:09.101450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:09.101722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] PATH_INFO: `/v3/users/9ccdfc8aa1564b52ab0d8e21790a2a80` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:09.102866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ccdfc8aa1564b52ab0d8e21790a2a80)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:09.104860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:09.881272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ccdfc8aa1564b52ab0d8e21790a2a80'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:09.893901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ccdfc8aa1564b52ab0d8e21790a2a80'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:09.986575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ccdfc8aa1564b52ab0d8e21790a2a80'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:09.987191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ccdfc8aa1564b52ab0d8e21790a2a80'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:09.995234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-941fccc8-d02f-45f5-b3ad-c698fcc9d749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ccdfc8aa1564b52ab0d8e21790a2a80'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:10.001180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1021/2069] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:59:09 2022] DELETE /identity/v3/users/9ccdfc8aa1564b52ab0d8e21790a2a80 => generated 0 bytes in 973 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:10.559942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:10.559942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:10.573250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28abe5-3e70-4a92-82f3-8ca3d5c8c567 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:10.662307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:10.663104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:10.663777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:10.664151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] PATH_INFO: `/v3/projects/2afef4c9871e455eb87a8ccf9359ccbc` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:10.665492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2afef4c9871e455eb87a8ccf9359ccbc)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:10.668426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:10.888861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2afef4c9871e455eb87a8ccf9359ccbc', 'request_id': 'req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:10.894859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2afef4c9871e455eb87a8ccf9359ccbc', 'request_id': 'req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:10.901902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2afef4c9871e455eb87a8ccf9359ccbc', 'request_id': 'req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:11.023726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] The token cache is being invalidate because project 2afef4c9871e455eb87a8ccf9359ccbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:59:11.024186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:11.025020 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c34f4c1a-6ba7-475e-9919-ab23bdf89bbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:11.027035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1049/2070] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:59:10 2022] DELETE /identity/v3/projects/2afef4c9871e455eb87a8ccf9359ccbc => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:11.043773 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe1ceb-a901-4054-8dd8-af730aa03249 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:11.045161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe1ceb-a901-4054-8dd8-af730aa03249 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:11.045684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe1ceb-a901-4054-8dd8-af730aa03249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:11.069252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-1bbe1ceb-a901-4054-8dd8-af730aa03249 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:11.070797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1bbe1ceb-a901-4054-8dd8-af730aa03249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:11.139094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1022/2071] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:11.148284 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fe4ad-3382-43c3-9306-5d4cfcc4704f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:11.148605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fe4ad-3382-43c3-9306-5d4cfcc4704f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:11.148906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fe4ad-3382-43c3-9306-5d4cfcc4704f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:11.169919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-919fe4ad-3382-43c3-9306-5d4cfcc4704f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:11.171152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-919fe4ad-3382-43c3-9306-5d4cfcc4704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:11.179764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1050/2072] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:11.184694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe1ceb-a901-4054-8dd8-af730aa03249 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:11.195133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe1ceb-a901-4054-8dd8-af730aa03249 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:11.200300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24240674-661b-4041-8230-3d757ca67657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:11.201002 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240674-661b-4041-8230-3d757ca67657 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:11.201286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240674-661b-4041-8230-3d757ca67657 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:11.201560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240674-661b-4041-8230-3d757ca67657 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:11.202239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24240674-661b-4041-8230-3d757ca67657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:59:11.202544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24240674-661b-4041-8230-3d757ca67657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:11.204482 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24240674-661b-4041-8230-3d757ca67657 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:11.218395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1023/2073] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:59:11.223888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fe4ad-3382-43c3-9306-5d4cfcc4704f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:11.234208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fe4ad-3382-43c3-9306-5d4cfcc4704f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:11.239195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf780c4-d7a5-491a-8f32-447e2c44d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:11.239817 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf780c4-d7a5-491a-8f32-447e2c44d49f admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:11.240101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf780c4-d7a5-491a-8f32-447e2c44d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:11.240385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf780c4-d7a5-491a-8f32-447e2c44d49f admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:11.243959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf780c4-d7a5-491a-8f32-447e2c44d49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:11.243959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf780c4-d7a5-491a-8f32-447e2c44d49f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:11.476439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1051/2074] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:59:11 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:59:11.480461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24240674-661b-4041-8230-3d757ca67657 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:11.490733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24240674-661b-4041-8230-3d757ca67657 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:11.550643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bd2e6-9005-481d-aa4b-0b8111c2abc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:11.551262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bd2e6-9005-481d-aa4b-0b8111c2abc3 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:11.551548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bd2e6-9005-481d-aa4b-0b8111c2abc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:11.551822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4bd2e6-9005-481d-aa4b-0b8111c2abc3 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:11.552547 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bd2e6-9005-481d-aa4b-0b8111c2abc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:11.554719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4bd2e6-9005-481d-aa4b-0b8111c2abc3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:11.741517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1024/2075] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:59:11 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:59:11.747604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf780c4-d7a5-491a-8f32-447e2c44d49f admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:11.760818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf780c4-d7a5-491a-8f32-447e2c44d49f admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:11.765884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58041cba-c56d-43b2-b6eb-79b9ce5dbe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:11.766763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58041cba-c56d-43b2-b6eb-79b9ce5dbe80 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:11.767353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58041cba-c56d-43b2-b6eb-79b9ce5dbe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:11.767806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58041cba-c56d-43b2-b6eb-79b9ce5dbe80 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:11.769669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58041cba-c56d-43b2-b6eb-79b9ce5dbe80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:11.771562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58041cba-c56d-43b2-b6eb-79b9ce5dbe80 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:11.782368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1052/2076] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:11.786762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bd2e6-9005-481d-aa4b-0b8111c2abc3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:11.800463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4bd2e6-9005-481d-aa4b-0b8111c2abc3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:11.806031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630e838-f98e-4e4d-90eb-3b240bb0ea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:11.806723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e838-f98e-4e4d-90eb-3b240bb0ea85 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:11.807072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e838-f98e-4e4d-90eb-3b240bb0ea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:11.807632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630e838-f98e-4e4d-90eb-3b240bb0ea85 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:11.808363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630e838-f98e-4e4d-90eb-3b240bb0ea85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:11.810180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630e838-f98e-4e4d-90eb-3b240bb0ea85 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:11.826338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1025/2077] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:11.833712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58041cba-c56d-43b2-b6eb-79b9ce5dbe80 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:11.856209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58041cba-c56d-43b2-b6eb-79b9ce5dbe80 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:11.862743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b755265-6114-4153-94b8-7e81171a092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:11.865613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755265-6114-4153-94b8-7e81171a092b admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:11.866027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755265-6114-4153-94b8-7e81171a092b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:11.866546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b755265-6114-4153-94b8-7e81171a092b admin admin] PATH_INFO: `/v3/projects/6fcfa2e6b8634f80a3ad05e50979c808/users/977c9ce3a61445fab584d7a551e4e93d/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:11.890228 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b755265-6114-4153-94b8-7e81171a092b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcfa2e6b8634f80a3ad05e50979c808, user_id=977c9ce3a61445fab584d7a551e4e93d, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:11.895598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b755265-6114-4153-94b8-7e81171a092b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:12.035367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1053/2078] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:59:11 2022] PUT /identity/v3/projects/6fcfa2e6b8634f80a3ad05e50979c808/users/977c9ce3a61445fab584d7a551e4e93d/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:59:12.040348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082fc1e-d021-45bc-9577-260dbbe3564a None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:12.040679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082fc1e-d021-45bc-9577-260dbbe3564a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:12.044639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082fc1e-d021-45bc-9577-260dbbe3564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:12.067017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-0082fc1e-d021-45bc-9577-260dbbe3564a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:12.068264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0082fc1e-d021-45bc-9577-260dbbe3564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:12.145497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1026/2079] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:12.155749 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b755265-6114-4153-94b8-7e81171a092b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:12.157758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2b755265-6114-4153-94b8-7e81171a092b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:12.226474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b755265-6114-4153-94b8-7e81171a092b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:12.230287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a938c92-d241-4bc4-95d3-2fa981116c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:12.230975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a938c92-d241-4bc4-95d3-2fa981116c48 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:12.231340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a938c92-d241-4bc4-95d3-2fa981116c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:12.231657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a938c92-d241-4bc4-95d3-2fa981116c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:12.241931 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a938c92-d241-4bc4-95d3-2fa981116c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:12.243421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a938c92-d241-4bc4-95d3-2fa981116c48 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:12.253869 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1054/2080] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:13.546205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:14.056395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2fec-9391-485e-a7b1-1e3df56bdbdf None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:14.057326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2fec-9391-485e-a7b1-1e3df56bdbdf None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:14.057771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2fec-9391-485e-a7b1-1e3df56bdbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:14.088208 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-9ddd2fec-9391-485e-a7b1-1e3df56bdbdf None None] MFA Rules not processed for user `977c9ce3a61445fab584d7a551e4e93d`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:14.089504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9ddd2fec-9391-485e-a7b1-1e3df56bdbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:14.155549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1027/2081] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:14.168389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a938c92-d241-4bc4-95d3-2fa981116c48 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:14.176450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0a938c92-d241-4bc4-95d3-2fa981116c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:14.230184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a938c92-d241-4bc4-95d3-2fa981116c48 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:14.233970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c84633-a4be-414c-b0dd-aa04a28db4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:14.234558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:14.234854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c84633-a4be-414c-b0dd-aa04a28db4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:14.234854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c84633-a4be-414c-b0dd-aa04a28db4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:14.235326 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c84633-a4be-414c-b0dd-aa04a28db4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:14.244588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c84633-a4be-414c-b0dd-aa04a28db4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:14.246122 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c84633-a4be-414c-b0dd-aa04a28db4d2 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:14.255348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1055/2082] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:16.633184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fbd35-d195-40be-8b32-803eb0d1b3c9 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:16.633662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fbd35-d195-40be-8b32-803eb0d1b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:16.633769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fbd35-d195-40be-8b32-803eb0d1b3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:16.654193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ab7fbd35-d195-40be-8b32-803eb0d1b3c9 None None] MFA Rules not processed for user `977c9ce3a61445fab584d7a551e4e93d`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:16.655461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ab7fbd35-d195-40be-8b32-803eb0d1b3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:16.663658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1028/2083] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:17.686652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c84633-a4be-414c-b0dd-aa04a28db4d2 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:17.688208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c1c84633-a4be-414c-b0dd-aa04a28db4d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:17.702217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c84633-a4be-414c-b0dd-aa04a28db4d2 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:17.707731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:17.708350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:17.708678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:17.708953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] PATH_INFO: `/v3/users/27adb592d14f4c9b8ee594f231ccf047` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:17.710291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27adb592d14f4c9b8ee594f231ccf047)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:17.712248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:17.977669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27adb592d14f4c9b8ee594f231ccf047'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:17.984735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27adb592d14f4c9b8ee594f231ccf047'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:18.073950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27adb592d14f4c9b8ee594f231ccf047'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:18.074812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27adb592d14f4c9b8ee594f231ccf047'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:18.075615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27adb592d14f4c9b8ee594f231ccf047'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:18.097098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1056/2084] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:59:17 2022] DELETE /identity/v3/users/27adb592d14f4c9b8ee594f231ccf047 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:18.103214 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c9ad8-32c4-4485-a5a5-64af5417bd97 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:18.103668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c9ad8-32c4-4485-a5a5-64af5417bd97 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:18.103962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c9ad8-32c4-4485-a5a5-64af5417bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:18.124038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-bf9c9ad8-32c4-4485-a5a5-64af5417bd97 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:18.125297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bf9c9ad8-32c4-4485-a5a5-64af5417bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:18.187199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1029/2085] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:18.197455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:18.198883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:18.256769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837938f-a057-49c9-8bf3-5e06c0e1aed0 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:18.260481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce6c0c-4ee9-4ace-8261-ba2bd859b650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:18.261149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6c0c-4ee9-4ace-8261-ba2bd859b650 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:18.261428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6c0c-4ee9-4ace-8261-ba2bd859b650 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:18.261697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6c0c-4ee9-4ace-8261-ba2bd859b650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:18.272784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce6c0c-4ee9-4ace-8261-ba2bd859b650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:18.274215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce6c0c-4ee9-4ace-8261-ba2bd859b650 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:18.285299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1057/2086] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:19.315823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c9ad8-32c4-4485-a5a5-64af5417bd97 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:19.317610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bf9c9ad8-32c4-4485-a5a5-64af5417bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:19.331398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c9ad8-32c4-4485-a5a5-64af5417bd97 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:19.337097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:19.337897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:19.338174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:19.338629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] PATH_INFO: `/v3/projects/51b1bdbfe39045beae7358ad2fcc9aad` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:19.339829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b1bdbfe39045beae7358ad2fcc9aad)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:19.344262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:19.562457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b1bdbfe39045beae7358ad2fcc9aad', 'request_id': 'req-7ba0499c-d58e-4939-a22d-52098f806d91'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:19.570533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:19.692240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b1bdbfe39045beae7358ad2fcc9aad', 'request_id': 'req-7ba0499c-d58e-4939-a22d-52098f806d91'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:19.708614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b1bdbfe39045beae7358ad2fcc9aad', 'request_id': 'req-7ba0499c-d58e-4939-a22d-52098f806d91'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:19.747821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] The token cache is being invalidate because project 51b1bdbfe39045beae7358ad2fcc9aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:59:19.748877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:19.762004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7ba0499c-d58e-4939-a22d-52098f806d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:19.765801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1030/2087] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:59:19 2022] DELETE /identity/v3/projects/51b1bdbfe39045beae7358ad2fcc9aad => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:19.773286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51ab08-feef-43a5-b1d4-5f04c1626d8e None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:19.774028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51ab08-feef-43a5-b1d4-5f04c1626d8e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:19.774615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51ab08-feef-43a5-b1d4-5f04c1626d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:19.810773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-2f51ab08-feef-43a5-b1d4-5f04c1626d8e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:19.812169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2f51ab08-feef-43a5-b1d4-5f04c1626d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:19.891524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1058/2088] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:19.899698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fc48-c81e-49b2-994e-79dbae617879 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:19.899984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fc48-c81e-49b2-994e-79dbae617879 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:19.900318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fc48-c81e-49b2-994e-79dbae617879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:19.931691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a9f4fc48-c81e-49b2-994e-79dbae617879 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:19.933423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a9f4fc48-c81e-49b2-994e-79dbae617879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:19.945448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1031/2089] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:59:19.949955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51ab08-feef-43a5-b1d4-5f04c1626d8e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:19.969287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51ab08-feef-43a5-b1d4-5f04c1626d8e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:19.987181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081f271-f0cb-491d-845f-4780e3f4acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:19.987812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081f271-f0cb-491d-845f-4780e3f4acfe admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:19.988638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081f271-f0cb-491d-845f-4780e3f4acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:19.988954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081f271-f0cb-491d-845f-4780e3f4acfe admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:19.989679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081f271-f0cb-491d-845f-4780e3f4acfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:59:19.989965 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081f271-f0cb-491d-845f-4780e3f4acfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:19.991595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081f271-f0cb-491d-845f-4780e3f4acfe admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:20.008687 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1059/2090] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:59:20.009549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4fc48-c81e-49b2-994e-79dbae617879 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:20.020604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4fc48-c81e-49b2-994e-79dbae617879 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:20.027330 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442decfc-b02c-400e-aeea-3f78548b1645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:20.028971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442decfc-b02c-400e-aeea-3f78548b1645 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:20.029381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442decfc-b02c-400e-aeea-3f78548b1645 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:20.029750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442decfc-b02c-400e-aeea-3f78548b1645 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:20.030659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442decfc-b02c-400e-aeea-3f78548b1645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:20.033516 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442decfc-b02c-400e-aeea-3f78548b1645 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:20.079410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:20.152526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1032/2091] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:59:20 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:59:20.156907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081f271-f0cb-491d-845f-4780e3f4acfe admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:20.170573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081f271-f0cb-491d-845f-4780e3f4acfe admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:20.249440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db82af-23dc-4151-bf1d-12536e14ca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:20.249667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db82af-23dc-4151-bf1d-12536e14ca09 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:20.250140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db82af-23dc-4151-bf1d-12536e14ca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:20.250559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db82af-23dc-4151-bf1d-12536e14ca09 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:20.251329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db82af-23dc-4151-bf1d-12536e14ca09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:20.254109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db82af-23dc-4151-bf1d-12536e14ca09 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:20.378973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1060/2092] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:59:20 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:59:20.383628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442decfc-b02c-400e-aeea-3f78548b1645 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:20.394170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442decfc-b02c-400e-aeea-3f78548b1645 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:20.398774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba14b2-7098-4f7e-9c79-98676c0ca7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:20.399455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba14b2-7098-4f7e-9c79-98676c0ca7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:20.399734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba14b2-7098-4f7e-9c79-98676c0ca7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:20.400004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba14b2-7098-4f7e-9c79-98676c0ca7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:20.400710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba14b2-7098-4f7e-9c79-98676c0ca7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:20.402306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba14b2-7098-4f7e-9c79-98676c0ca7f8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:20.417846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1033/2093] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:20.421885 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db82af-23dc-4151-bf1d-12536e14ca09 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:20.433752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db82af-23dc-4151-bf1d-12536e14ca09 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:20.445795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ab5b6-b468-4cd9-83c2-cc2e262a78ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:20.446480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ab5b6-b468-4cd9-83c2-cc2e262a78ad admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:20.446765 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ab5b6-b468-4cd9-83c2-cc2e262a78ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:20.447038 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ab5b6-b468-4cd9-83c2-cc2e262a78ad admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:20.447892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ab5b6-b468-4cd9-83c2-cc2e262a78ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:20.450956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ab5b6-b468-4cd9-83c2-cc2e262a78ad admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:20.465511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1061/2094] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:20.469317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba14b2-7098-4f7e-9c79-98676c0ca7f8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:20.482213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba14b2-7098-4f7e-9c79-98676c0ca7f8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:20.497264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b0595-d245-4a83-9d43-2aa990ce5fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:20.497960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0595-d245-4a83-9d43-2aa990ce5fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:20.498241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0595-d245-4a83-9d43-2aa990ce5fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:20.498521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0595-d245-4a83-9d43-2aa990ce5fb7 admin admin] PATH_INFO: `/v3/projects/8acf3838c7de4add99d51667b40f5d03/users/e031381744f54bd38e0ea250f0e3abd1/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:20.518570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b0595-d245-4a83-9d43-2aa990ce5fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acf3838c7de4add99d51667b40f5d03, user_id=e031381744f54bd38e0ea250f0e3abd1, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:20.522797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b0595-d245-4a83-9d43-2aa990ce5fb7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:20.613028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1034/2095] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:59:20 2022] PUT /identity/v3/projects/8acf3838c7de4add99d51667b40f5d03/users/e031381744f54bd38e0ea250f0e3abd1/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:59:20.619387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f8ac-343f-4e76-b450-a803b1abedbd None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:20.619880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f8ac-343f-4e76-b450-a803b1abedbd None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:20.620146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6f8ac-343f-4e76-b450-a803b1abedbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:20.641469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-2bd6f8ac-343f-4e76-b450-a803b1abedbd None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:20.642708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2bd6f8ac-343f-4e76-b450-a803b1abedbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:20.705606 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1062/2096] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:20.716938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b0595-d245-4a83-9d43-2aa990ce5fb7 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:20.721462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-583b0595-d245-4a83-9d43-2aa990ce5fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:20.802101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b0595-d245-4a83-9d43-2aa990ce5fb7 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:20.808235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963e085-88df-4779-8ebd-c4ef358485d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:20.808972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963e085-88df-4779-8ebd-c4ef358485d5 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:20.809253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963e085-88df-4779-8ebd-c4ef358485d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:20.809530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963e085-88df-4779-8ebd-c4ef358485d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:20.833383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963e085-88df-4779-8ebd-c4ef358485d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:20.835748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963e085-88df-4779-8ebd-c4ef358485d5 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:20.854138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1035/2097] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:22.010643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5480d-a28d-46fa-8cc6-21b97c61841e None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:22.011740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5480d-a28d-46fa-8cc6-21b97c61841e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:22.012217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5480d-a28d-46fa-8cc6-21b97c61841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:22.049935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d3b5480d-a28d-46fa-8cc6-21b97c61841e None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:22.049935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d3b5480d-a28d-46fa-8cc6-21b97c61841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:22.154954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1063/2098] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 15:59:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:59:22.221803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963e085-88df-4779-8ebd-c4ef358485d5 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:22.224667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c963e085-88df-4779-8ebd-c4ef358485d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:22.346572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963e085-88df-4779-8ebd-c4ef358485d5 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:22.353201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878f3f9-4642-48a7-8973-042d22b6a6fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:22.353832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878f3f9-4642-48a7-8973-042d22b6a6fa service swift] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:22.354116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878f3f9-4642-48a7-8973-042d22b6a6fa service swift] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:22.354391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878f3f9-4642-48a7-8973-042d22b6a6fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:22.365576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878f3f9-4642-48a7-8973-042d22b6a6fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:22.367265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878f3f9-4642-48a7-8973-042d22b6a6fa service swift] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:22.376737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1036/2099] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 15:59:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 15:59:24.056963 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:24.360458 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5480d-a28d-46fa-8cc6-21b97c61841e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:24.362049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d3b5480d-a28d-46fa-8cc6-21b97c61841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:24.382619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5480d-a28d-46fa-8cc6-21b97c61841e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:24.389374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:24.390361 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:24.390821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:24.391263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] PATH_INFO: `/v3/users/1f6b88d1b4d6488dbcbfbd7407447b89` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:24.392621 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6b88d1b4d6488dbcbfbd7407447b89)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:24.394850 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:24.458529 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1921a-0d21-42d1-a6a6-fa32f04c1608 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:24.459679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1921a-0d21-42d1-a6a6-fa32f04c1608 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:24.459959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1921a-0d21-42d1-a6a6-fa32f04c1608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:24.494945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:24.499249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a6b1921a-0d21-42d1-a6a6-fa32f04c1608 None None] MFA Rules not processed for user `e031381744f54bd38e0ea250f0e3abd1`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:24.500652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a6b1921a-0d21-42d1-a6a6-fa32f04c1608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:24.613486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1037/2100] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:59:24.624579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1921a-0d21-42d1-a6a6-fa32f04c1608 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:24.625964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a6b1921a-0d21-42d1-a6a6-fa32f04c1608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:24.706431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1921a-0d21-42d1-a6a6-fa32f04c1608 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:24.712500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25948381-5131-4205-8efc-6bee965bc4ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:24.713827 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25948381-5131-4205-8efc-6bee965bc4ff service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:24.714289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25948381-5131-4205-8efc-6bee965bc4ff service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:24.715078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25948381-5131-4205-8efc-6bee965bc4ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:24.720736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6b88d1b4d6488dbcbfbd7407447b89'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:24.727660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25948381-5131-4205-8efc-6bee965bc4ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:24.729921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25948381-5131-4205-8efc-6bee965bc4ff service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:24.730601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6b88d1b4d6488dbcbfbd7407447b89'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:24.741854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1038/2101] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:59:24.840546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6b88d1b4d6488dbcbfbd7407447b89'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:24.841389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6b88d1b4d6488dbcbfbd7407447b89'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:24.843319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6b88d1b4d6488dbcbfbd7407447b89'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:24.878189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1064/2102] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:59:24 2022] DELETE /identity/v3/users/1f6b88d1b4d6488dbcbfbd7407447b89 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:24.883325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81cd8-028b-4e01-b04f-af13ff5203f0 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:24.887537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81cd8-028b-4e01-b04f-af13ff5203f0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:24.887537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81cd8-028b-4e01-b04f-af13ff5203f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:24.953095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-49d81cd8-028b-4e01-b04f-af13ff5203f0 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:24.954812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-49d81cd8-028b-4e01-b04f-af13ff5203f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:25.075008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1039/2103] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:25.087318 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:25.090051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:25.200330 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464d90c-fda7-4902-97bd-84e583949244 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:25.204964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075dcea-0439-4f0d-871d-6e4e8ce4a3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:25.205599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075dcea-0439-4f0d-871d-6e4e8ce4a3ae service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:25.205879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075dcea-0439-4f0d-871d-6e4e8ce4a3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:25.206150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075dcea-0439-4f0d-871d-6e4e8ce4a3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:25.226409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075dcea-0439-4f0d-871d-6e4e8ce4a3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:25.226709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075dcea-0439-4f0d-871d-6e4e8ce4a3ae service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:25.265783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1065/2104] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:26.383523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81cd8-028b-4e01-b04f-af13ff5203f0 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:26.385152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-49d81cd8-028b-4e01-b04f-af13ff5203f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:26.398267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81cd8-028b-4e01-b04f-af13ff5203f0 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:26.411500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:26.411500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:26.411500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:26.411500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] PATH_INFO: `/v3/projects/cabb833e27614b92af8a49aa82c3fd19` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:26.411868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cabb833e27614b92af8a49aa82c3fd19)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:26.413257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:26.604836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cabb833e27614b92af8a49aa82c3fd19', 'request_id': 'req-5d0369b8-335e-4b77-8b35-2f83213bd260'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:26.747365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cabb833e27614b92af8a49aa82c3fd19', 'request_id': 'req-5d0369b8-335e-4b77-8b35-2f83213bd260'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:26.763761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cabb833e27614b92af8a49aa82c3fd19', 'request_id': 'req-5d0369b8-335e-4b77-8b35-2f83213bd260'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:26.784713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] The token cache is being invalidate because project cabb833e27614b92af8a49aa82c3fd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:59:26.785032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:26.789615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d0369b8-335e-4b77-8b35-2f83213bd260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:26.792059 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1040/2105] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:59:26 2022] DELETE /identity/v3/projects/cabb833e27614b92af8a49aa82c3fd19 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:26.797014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe96b0-916f-417c-a8fe-e170e7a23e46 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:26.797560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe96b0-916f-417c-a8fe-e170e7a23e46 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:26.797774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe96b0-916f-417c-a8fe-e170e7a23e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:26.824764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0fbe96b0-916f-417c-a8fe-e170e7a23e46 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:26.824764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0fbe96b0-916f-417c-a8fe-e170e7a23e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:26.898691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1066/2106] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:26.907342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3883f5-6a64-48a1-a3dc-5999ce5d71d9 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:26.908404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3883f5-6a64-48a1-a3dc-5999ce5d71d9 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:26.908553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3883f5-6a64-48a1-a3dc-5999ce5d71d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:26.949785 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ea3883f5-6a64-48a1-a3dc-5999ce5d71d9 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:26.951078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ea3883f5-6a64-48a1-a3dc-5999ce5d71d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:26.964298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1041/2107] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:26.965471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe96b0-916f-417c-a8fe-e170e7a23e46 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:26.982019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe96b0-916f-417c-a8fe-e170e7a23e46 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:26.988842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3e669-ba14-403e-8e6f-91b6233707a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:26.989893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3e669-ba14-403e-8e6f-91b6233707a8 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:26.990267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3e669-ba14-403e-8e6f-91b6233707a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:26.990617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3e669-ba14-403e-8e6f-91b6233707a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:26.991449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3e669-ba14-403e-8e6f-91b6233707a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:59:26.992441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3e669-ba14-403e-8e6f-91b6233707a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:26.994132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3e669-ba14-403e-8e6f-91b6233707a8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:27.011138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1067/2108] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:59:27.015532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3883f5-6a64-48a1-a3dc-5999ce5d71d9 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:27.026525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3883f5-6a64-48a1-a3dc-5999ce5d71d9 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:27.038134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefdf16-f972-4643-8e6c-5a1037c5878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:27.038850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefdf16-f972-4643-8e6c-5a1037c5878e admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:27.039131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefdf16-f972-4643-8e6c-5a1037c5878e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:27.039405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefdf16-f972-4643-8e6c-5a1037c5878e admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:27.040076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefdf16-f972-4643-8e6c-5a1037c5878e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:27.042195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefdf16-f972-4643-8e6c-5a1037c5878e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:27.043852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc244-7495-49ab-a0ed-08d4c3fb7f05 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:27.044131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc244-7495-49ab-a0ed-08d4c3fb7f05 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:27.044411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc244-7495-49ab-a0ed-08d4c3fb7f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:27.079312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d02cc244-7495-49ab-a0ed-08d4c3fb7f05 None None] MFA Rules not processed for user `e031381744f54bd38e0ea250f0e3abd1`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:27.081674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d02cc244-7495-49ab-a0ed-08d4c3fb7f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:27.172834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1068/2109] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:59:27.287177 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1042/2110] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:59:27 2022] POST /identity/v3/projects => generated 375 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:59:27.291396 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cc244-7495-49ab-a0ed-08d4c3fb7f05 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:27.307465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cc244-7495-49ab-a0ed-08d4c3fb7f05 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:27.389810 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db344d-95c8-45ef-a672-d5724b25f40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:27.392367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db344d-95c8-45ef-a672-d5724b25f40d admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:27.392367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db344d-95c8-45ef-a672-d5724b25f40d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:27.392367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db344d-95c8-45ef-a672-d5724b25f40d admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:27.393024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db344d-95c8-45ef-a672-d5724b25f40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:27.398584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db344d-95c8-45ef-a672-d5724b25f40d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:27.497069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1069/2111] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:59:27 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:59:27.501572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefdf16-f972-4643-8e6c-5a1037c5878e admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:27.517060 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefdf16-f972-4643-8e6c-5a1037c5878e admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:27.526216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2afd2a-bcd6-48be-9451-6d79b9ccdb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:27.526949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2afd2a-bcd6-48be-9451-6d79b9ccdb32 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:27.527248 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2afd2a-bcd6-48be-9451-6d79b9ccdb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:27.527559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2afd2a-bcd6-48be-9451-6d79b9ccdb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:27.528263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2afd2a-bcd6-48be-9451-6d79b9ccdb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:27.529996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2afd2a-bcd6-48be-9451-6d79b9ccdb32 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:27.548938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1043/2112] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:27.552927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db344d-95c8-45ef-a672-d5724b25f40d admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:27.571292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db344d-95c8-45ef-a672-d5724b25f40d admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:27.581111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4fda1-e978-4c6d-8918-e55b0eeddcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:27.582566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4fda1-e978-4c6d-8918-e55b0eeddcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:27.582892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4fda1-e978-4c6d-8918-e55b0eeddcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:27.583185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4fda1-e978-4c6d-8918-e55b0eeddcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:27.583876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4fda1-e978-4c6d-8918-e55b0eeddcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:27.586144 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4fda1-e978-4c6d-8918-e55b0eeddcc8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:27.601099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1070/2113] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:27.604366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:27.605088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2afd2a-bcd6-48be-9451-6d79b9ccdb32 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:27.619950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2afd2a-bcd6-48be-9451-6d79b9ccdb32 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:27.633308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27bac5-a5c8-472c-b822-5eeab21158da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:27.636150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27bac5-a5c8-472c-b822-5eeab21158da admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:27.637250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27bac5-a5c8-472c-b822-5eeab21158da admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:27.637827 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27bac5-a5c8-472c-b822-5eeab21158da admin admin] PATH_INFO: `/v3/projects/b9a23e09122e4ef29a3681b75a97c58a/users/eebd4c8aa8da4aebb832ce51dbaf3166/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:27.663194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27bac5-a5c8-472c-b822-5eeab21158da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a23e09122e4ef29a3681b75a97c58a, user_id=eebd4c8aa8da4aebb832ce51dbaf3166, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:27.668121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27bac5-a5c8-472c-b822-5eeab21158da admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:27.760837 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1044/2114] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:59:27 2022] PUT /identity/v3/projects/b9a23e09122e4ef29a3681b75a97c58a/users/eebd4c8aa8da4aebb832ce51dbaf3166/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:27.761823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95459e-bb6d-4862-b038-b633b38ecc32 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:27.762319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95459e-bb6d-4862-b038-b633b38ecc32 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:27.762634 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95459e-bb6d-4862-b038-b633b38ecc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:27.856706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:27.864941 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-ca95459e-bb6d-4862-b038-b633b38ecc32 None None] MFA Rules not processed for user `eebd4c8aa8da4aebb832ce51dbaf3166`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:27.866765 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ca95459e-bb6d-4862-b038-b633b38ecc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:27.976493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1071/2115] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:27.980996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27bac5-a5c8-472c-b822-5eeab21158da admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:28.082308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27bac5-a5c8-472c-b822-5eeab21158da admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:28.112210 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c538-48cd-4e00-8d9a-5f6a08685ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:28.113574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c538-48cd-4e00-8d9a-5f6a08685ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:28.113870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c538-48cd-4e00-8d9a-5f6a08685ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:28.113954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c538-48cd-4e00-8d9a-5f6a08685ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:28.114704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9c538-48cd-4e00-8d9a-5f6a08685ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:28.124824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9c538-48cd-4e00-8d9a-5f6a08685ad0 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:28.235672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1045/2116] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:59:27 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:59:28.240306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95459e-bb6d-4862-b038-b633b38ecc32 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:28.258679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95459e-bb6d-4862-b038-b633b38ecc32 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:28.344821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612f6a-798c-4e11-899b-b2160047f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:28.345493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612f6a-798c-4e11-899b-b2160047f556 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:28.345715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612f6a-798c-4e11-899b-b2160047f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:28.345987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612f6a-798c-4e11-899b-b2160047f556 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:28.346617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98612f6a-798c-4e11-899b-b2160047f556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:28.351294 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98612f6a-798c-4e11-899b-b2160047f556 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:28.466368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1072/2117] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:59:28 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:59:28.467636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c538-48cd-4e00-8d9a-5f6a08685ad0 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:28.493748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c538-48cd-4e00-8d9a-5f6a08685ad0 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:28.500216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87287c9-ad5b-4814-92a0-bb02e896efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:28.500907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87287c9-ad5b-4814-92a0-bb02e896efc7 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:28.501871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87287c9-ad5b-4814-92a0-bb02e896efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:28.501871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87287c9-ad5b-4814-92a0-bb02e896efc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:28.502512 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87287c9-ad5b-4814-92a0-bb02e896efc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:28.504571 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87287c9-ad5b-4814-92a0-bb02e896efc7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:28.525590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1046/2118] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:28.526857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612f6a-798c-4e11-899b-b2160047f556 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:28.540804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612f6a-798c-4e11-899b-b2160047f556 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:28.547526 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c694d-88b1-4670-b640-caefccbfc1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:28.548386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c694d-88b1-4670-b640-caefccbfc1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:28.548702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c694d-88b1-4670-b640-caefccbfc1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:28.548979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c694d-88b1-4670-b640-caefccbfc1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:28.549643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c694d-88b1-4670-b640-caefccbfc1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:28.552596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c694d-88b1-4670-b640-caefccbfc1b8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:28.576259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1073/2119] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:28.577105 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87287c9-ad5b-4814-92a0-bb02e896efc7 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:28.595399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87287c9-ad5b-4814-92a0-bb02e896efc7 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:28.599675 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69ba39-20ab-40b1-ad1d-444808fc1c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:28.600787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ba39-20ab-40b1-ad1d-444808fc1c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:28.601071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ba39-20ab-40b1-ad1d-444808fc1c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:28.601399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ba39-20ab-40b1-ad1d-444808fc1c55 admin admin] PATH_INFO: `/v3/projects/6445de6e532c4908a6ec6c78d40c2dd0/users/ece88042c4d4430a96ff88f08092a562/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:28.629877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69ba39-20ab-40b1-ad1d-444808fc1c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6445de6e532c4908a6ec6c78d40c2dd0, user_id=ece88042c4d4430a96ff88f08092a562, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:28.629877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69ba39-20ab-40b1-ad1d-444808fc1c55 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:28.726740 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1047/2120] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:59:28 2022] PUT /identity/v3/projects/6445de6e532c4908a6ec6c78d40c2dd0/users/ece88042c4d4430a96ff88f08092a562/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:59:28.737162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe74d-ec38-4966-8b3f-d00d67ba91c9 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:28.737455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe74d-ec38-4966-8b3f-d00d67ba91c9 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:28.737706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe74d-ec38-4966-8b3f-d00d67ba91c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:28.770027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-67dfe74d-ec38-4966-8b3f-d00d67ba91c9 None None] MFA Rules not processed for user `ece88042c4d4430a96ff88f08092a562`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:28.775212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-67dfe74d-ec38-4966-8b3f-d00d67ba91c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:28.886569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1074/2121] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:28.893381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69ba39-20ab-40b1-ad1d-444808fc1c55 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:28.994536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69ba39-20ab-40b1-ad1d-444808fc1c55 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:29.003808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69658bb2-8d5a-4324-84ff-c65239d56968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:29.004546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69658bb2-8d5a-4324-84ff-c65239d56968 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:29.004911 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69658bb2-8d5a-4324-84ff-c65239d56968 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:29.005092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69658bb2-8d5a-4324-84ff-c65239d56968 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:29.005753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69658bb2-8d5a-4324-84ff-c65239d56968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:29.007823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69658bb2-8d5a-4324-84ff-c65239d56968 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:29.151912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1048/2122] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:59:28 2022] POST /identity/v3/projects => generated 377 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:59:29.156236 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfe74d-ec38-4966-8b3f-d00d67ba91c9 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:29.183148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfe74d-ec38-4966-8b3f-d00d67ba91c9 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:29.270131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac33a0-43dd-4ecb-80ea-80ce61b347ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:29.273660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac33a0-43dd-4ecb-80ea-80ce61b347ba admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:29.274062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac33a0-43dd-4ecb-80ea-80ce61b347ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:29.274497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac33a0-43dd-4ecb-80ea-80ce61b347ba admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:29.275271 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac33a0-43dd-4ecb-80ea-80ce61b347ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:29.280353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac33a0-43dd-4ecb-80ea-80ce61b347ba admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:29.409535 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1075/2123] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:59:29 2022] POST /identity/v3/users => generated 295 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:59:29.414055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69658bb2-8d5a-4324-84ff-c65239d56968 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:29.428692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69658bb2-8d5a-4324-84ff-c65239d56968 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:29.448786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffd7b5-eb49-4a00-91ce-76183a843aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:29.449408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffd7b5-eb49-4a00-91ce-76183a843aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:29.449691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffd7b5-eb49-4a00-91ce-76183a843aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:29.449969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffd7b5-eb49-4a00-91ce-76183a843aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:29.450622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffd7b5-eb49-4a00-91ce-76183a843aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:29.452250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffd7b5-eb49-4a00-91ce-76183a843aa2 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:29.469596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1049/2124] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:29.474204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac33a0-43dd-4ecb-80ea-80ce61b347ba admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:29.485387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac33a0-43dd-4ecb-80ea-80ce61b347ba admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:29.491960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c54200-18ea-441e-bcd6-5aabba4323a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:29.493361 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54200-18ea-441e-bcd6-5aabba4323a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:29.493881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54200-18ea-441e-bcd6-5aabba4323a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:29.494165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54200-18ea-441e-bcd6-5aabba4323a4 admin admin] PATH_INFO: `/v3/projects/075b622bcb1c4758a40ecc907aecc2b9/users/2273a6542a6947f595ee8278f848f2c8/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:29.524881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c54200-18ea-441e-bcd6-5aabba4323a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=075b622bcb1c4758a40ecc907aecc2b9, user_id=2273a6542a6947f595ee8278f848f2c8, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:29.527742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c54200-18ea-441e-bcd6-5aabba4323a4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:29.656007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1076/2125] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:59:29 2022] PUT /identity/v3/projects/075b622bcb1c4758a40ecc907aecc2b9/users/2273a6542a6947f595ee8278f848f2c8/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:29.660325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffd7b5-eb49-4a00-91ce-76183a843aa2 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:29.673133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffd7b5-eb49-4a00-91ce-76183a843aa2 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:29.739947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec9974-2d2b-432a-baee-f9bf74bd7e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:29.740964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9974-2d2b-432a-baee-f9bf74bd7e3e admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:29.741160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9974-2d2b-432a-baee-f9bf74bd7e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:29.741425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9974-2d2b-432a-baee-f9bf74bd7e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:29.742374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec9974-2d2b-432a-baee-f9bf74bd7e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:29.744011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec9974-2d2b-432a-baee-f9bf74bd7e3e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:29.758857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1050/2126] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:29.760071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c54200-18ea-441e-bcd6-5aabba4323a4 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:29.771210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c54200-18ea-441e-bcd6-5aabba4323a4 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:29.776333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dcba5-808f-4542-add1-ad182710e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:29.777058 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dcba5-808f-4542-add1-ad182710e847 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:29.777336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dcba5-808f-4542-add1-ad182710e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:29.777609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dcba5-808f-4542-add1-ad182710e847 admin admin] PATH_INFO: `/v3/projects/075b622bcb1c4758a40ecc907aecc2b9/users/2273a6542a6947f595ee8278f848f2c8/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:29.779588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40dcba5-808f-4542-add1-ad182710e847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=075b622bcb1c4758a40ecc907aecc2b9, user_id=2273a6542a6947f595ee8278f848f2c8, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:29.782499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40dcba5-808f-4542-add1-ad182710e847 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:29.799639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1077/2127] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:59:29 2022] PUT /identity/v3/projects/075b622bcb1c4758a40ecc907aecc2b9/users/2273a6542a6947f595ee8278f848f2c8/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:59:29.813999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7b224-6668-40b1-b579-c11ce9571bb8 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:29.814376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7b224-6668-40b1-b579-c11ce9571bb8 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:29.814654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7b224-6668-40b1-b579-c11ce9571bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:29.849833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-09c7b224-6668-40b1-b579-c11ce9571bb8 None None] MFA Rules not processed for user `2273a6542a6947f595ee8278f848f2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:29.851314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-09c7b224-6668-40b1-b579-c11ce9571bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:29.958146 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1051/2128] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:29.975040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dcba5-808f-4542-add1-ad182710e847 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:29.976958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d40dcba5-808f-4542-add1-ad182710e847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:30.040180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dcba5-808f-4542-add1-ad182710e847 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:30.044277 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c01ebc-cea1-40a9-83e6-d846c68120ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:30.044938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c01ebc-cea1-40a9-83e6-d846c68120ed service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:30.045220 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c01ebc-cea1-40a9-83e6-d846c68120ed service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:30.045496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c01ebc-cea1-40a9-83e6-d846c68120ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:30.106192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c01ebc-cea1-40a9-83e6-d846c68120ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:30.107591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c01ebc-cea1-40a9-83e6-d846c68120ed service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:30.117367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1078/2129] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:31.701916 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:31.993644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:33.110001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7b224-6668-40b1-b579-c11ce9571bb8 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:33.114638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-09c7b224-6668-40b1-b579-c11ce9571bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:33.177211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7b224-6668-40b1-b579-c11ce9571bb8 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:33.181492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa339b4b-f0bf-443c-933e-2fc873312162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:33.182166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa339b4b-f0bf-443c-933e-2fc873312162 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:33.182447 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa339b4b-f0bf-443c-933e-2fc873312162 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:33.182708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa339b4b-f0bf-443c-933e-2fc873312162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:33.272699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa339b4b-f0bf-443c-933e-2fc873312162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:33.274164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa339b4b-f0bf-443c-933e-2fc873312162 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:33.297032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1052/2130] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:36.345121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c01ebc-cea1-40a9-83e6-d846c68120ed service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:36.354533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c01ebc-cea1-40a9-83e6-d846c68120ed service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:36.358824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadb0ba-4466-47e1-9d92-be4198c3d2c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:36.359668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadb0ba-4466-47e1-9d92-be4198c3d2c4 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:36.359929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadb0ba-4466-47e1-9d92-be4198c3d2c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:36.360196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadb0ba-4466-47e1-9d92-be4198c3d2c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:36.373445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadb0ba-4466-47e1-9d92-be4198c3d2c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:36.374999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadb0ba-4466-47e1-9d92-be4198c3d2c4 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:36.392601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1079/2131] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:36.822039 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:37.233910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:40.484596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:41.422016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:41.625628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa339b4b-f0bf-443c-933e-2fc873312162 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:41.729356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa339b4b-f0bf-443c-933e-2fc873312162 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:41.735095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:41.736034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:41.736549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:41.737057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] PATH_INFO: `/v3/users/eebd4c8aa8da4aebb832ce51dbaf3166` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:41.738996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eebd4c8aa8da4aebb832ce51dbaf3166)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:41.741840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:42.011712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eebd4c8aa8da4aebb832ce51dbaf3166'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:42.037838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eebd4c8aa8da4aebb832ce51dbaf3166'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:42.171066 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eebd4c8aa8da4aebb832ce51dbaf3166'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:42.173096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eebd4c8aa8da4aebb832ce51dbaf3166'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:42.180085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eebd4c8aa8da4aebb832ce51dbaf3166'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:42.187915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1053/2132] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:59:41 2022] DELETE /identity/v3/users/eebd4c8aa8da4aebb832ce51dbaf3166 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:42.192959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0c068-5847-4193-9644-a0f992a1d5e0 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:42.193491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0c068-5847-4193-9644-a0f992a1d5e0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:42.193491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0c068-5847-4193-9644-a0f992a1d5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:42.215855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-ddd0c068-5847-4193-9644-a0f992a1d5e0 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:42.217162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ddd0c068-5847-4193-9644-a0f992a1d5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:42.294894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1080/2133] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:42.307263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:42.314427 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:42.392607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bebdc2-eeb8-4465-825a-f867f6cdc006 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:42.397567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864df751-301f-46fc-9a86-2bd4d68bc0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:42.398455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864df751-301f-46fc-9a86-2bd4d68bc0bb service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:42.398853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864df751-301f-46fc-9a86-2bd4d68bc0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:42.399141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864df751-301f-46fc-9a86-2bd4d68bc0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:42.411865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864df751-301f-46fc-9a86-2bd4d68bc0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:42.413406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864df751-301f-46fc-9a86-2bd4d68bc0bb service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:42.424070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1054/2134] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:43.211335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0c068-5847-4193-9644-a0f992a1d5e0 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:43.212939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ddd0c068-5847-4193-9644-a0f992a1d5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:43.225857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0c068-5847-4193-9644-a0f992a1d5e0 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:43.230834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:43.231301 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:43.231806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:43.232087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] PATH_INFO: `/v3/projects/b9a23e09122e4ef29a3681b75a97c58a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:43.233265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a23e09122e4ef29a3681b75a97c58a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:43.237273 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:43.432333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a23e09122e4ef29a3681b75a97c58a', 'request_id': 'req-ee6044a4-fd24-4933-a80a-77e969ceb084'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:43.438239 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a23e09122e4ef29a3681b75a97c58a', 'request_id': 'req-ee6044a4-fd24-4933-a80a-77e969ceb084'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:43.445498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a23e09122e4ef29a3681b75a97c58a', 'request_id': 'req-ee6044a4-fd24-4933-a80a-77e969ceb084'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:43.585476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] The token cache is being invalidate because project b9a23e09122e4ef29a3681b75a97c58a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:59:43.586858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:43.587879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:43.589879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1081/2135] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:59:43 2022] DELETE /identity/v3/projects/b9a23e09122e4ef29a3681b75a97c58a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:43.595228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864df751-301f-46fc-9a86-2bd4d68bc0bb service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:43.608189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864df751-301f-46fc-9a86-2bd4d68bc0bb service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:43.671921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:43.672482 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:43.672811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:43.673081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] PATH_INFO: `/v3/users/ece88042c4d4430a96ff88f08092a562` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:43.674264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece88042c4d4430a96ff88f08092a562)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:43.676241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:43.935147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece88042c4d4430a96ff88f08092a562'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:43.947792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:43.948788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece88042c4d4430a96ff88f08092a562'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:44.027562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece88042c4d4430a96ff88f08092a562'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:44.028219 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece88042c4d4430a96ff88f08092a562'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:44.036696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9d498264-07e1-4b45-9aa7-ab0bd5ae6545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece88042c4d4430a96ff88f08092a562'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:44.043025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1055/2136] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:59:43 2022] DELETE /identity/v3/users/ece88042c4d4430a96ff88f08092a562 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:59:44.598569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:44.600412 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:44.628948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335ebf-9a30-4601-ba57-217dd63e78c6 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:44.631007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335ebf-9a30-4601-ba57-217dd63e78c6 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:44.632358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335ebf-9a30-4601-ba57-217dd63e78c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:44.632853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6044a4-fd24-4933-a80a-77e969ceb084 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:44.654536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ac335ebf-9a30-4601-ba57-217dd63e78c6 None None] MFA Rules not processed for user `977c9ce3a61445fab584d7a551e4e93d`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:44.656046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ac335ebf-9a30-4601-ba57-217dd63e78c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:44.696249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:44.696924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:44.697204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:44.697473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] PATH_INFO: `/v3/projects/6445de6e532c4908a6ec6c78d40c2dd0` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:44.698601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6445de6e532c4908a6ec6c78d40c2dd0)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:44.700529 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:44.723715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1056/2137] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:44.856332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6445de6e532c4908a6ec6c78d40c2dd0', 'request_id': 'req-d0be2aac-e207-4abf-9260-4d4b63fe6066'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:44.866406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6445de6e532c4908a6ec6c78d40c2dd0', 'request_id': 'req-d0be2aac-e207-4abf-9260-4d4b63fe6066'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:44.877944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6445de6e532c4908a6ec6c78d40c2dd0', 'request_id': 'req-d0be2aac-e207-4abf-9260-4d4b63fe6066'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:44.969094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] The token cache is being invalidate because project 6445de6e532c4908a6ec6c78d40c2dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:59:44.969094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:44.969094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d0be2aac-e207-4abf-9260-4d4b63fe6066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:44.970108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1082/2138] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:59:44 2022] DELETE /identity/v3/projects/6445de6e532c4908a6ec6c78d40c2dd0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:44.974043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335ebf-9a30-4601-ba57-217dd63e78c6 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:44.976800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ac335ebf-9a30-4601-ba57-217dd63e78c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:44.991983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335ebf-9a30-4601-ba57-217dd63e78c6 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:45.067810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:45.068648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:45.069034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:45.069359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] PATH_INFO: `/v3/users/2273a6542a6947f595ee8278f848f2c8` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:45.071143 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2273a6542a6947f595ee8278f848f2c8)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:45.072668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:45.406980 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2273a6542a6947f595ee8278f848f2c8'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:45.419083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2273a6542a6947f595ee8278f848f2c8'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:45.542293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2273a6542a6947f595ee8278f848f2c8'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:45.552298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2273a6542a6947f595ee8278f848f2c8'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:45.553425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1ed1b8ba-5939-476b-9369-8455666d9c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2273a6542a6947f595ee8278f848f2c8'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:45.564835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1057/2139] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 15:59:44 2022] DELETE /identity/v3/users/2273a6542a6947f595ee8278f848f2c8 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:45.931038 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8a074-7b02-49f5-b0e6-bcd9dc25ae65 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:45.932114 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8a074-7b02-49f5-b0e6-bcd9dc25ae65 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:45.932844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8a074-7b02-49f5-b0e6-bcd9dc25ae65 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:45.936017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1083/2140] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 15:59:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:59:45.943290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201d509-9479-4573-bca4-771f40907c0e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:45.943815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201d509-9479-4573-bca4-771f40907c0e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:45.944129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201d509-9479-4573-bca4-771f40907c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:45.968763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-9201d509-9479-4573-bca4-771f40907c0e None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:45.970068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9201d509-9479-4573-bca4-771f40907c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:46.057643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1058/2141] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:46.073560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:46.075791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8a074-7b02-49f5-b0e6-bcd9dc25ae65 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:46.077855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0cc8a074-7b02-49f5-b0e6-bcd9dc25ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:46.163075 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8a074-7b02-49f5-b0e6-bcd9dc25ae65 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:46.167285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6149305-82dc-4c47-9277-19ef239c1226 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2de83ba29194578a9a229d5bab6612e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:46.167958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6149305-82dc-4c47-9277-19ef239c1226 service glance] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.168289 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6149305-82dc-4c47-9277-19ef239c1226 service glance] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.168605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6149305-82dc-4c47-9277-19ef239c1226 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.180124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6149305-82dc-4c47-9277-19ef239c1226 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:46.186167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6149305-82dc-4c47-9277-19ef239c1226 service glance] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:46.193209 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1084/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:46.207435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201d509-9479-4573-bca4-771f40907c0e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:46.208905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9201d509-9479-4573-bca4-771f40907c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:46.306202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201d509-9479-4573-bca4-771f40907c0e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:46.314897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:46.317720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.317720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.317720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] PATH_INFO: `/v3/projects/075b622bcb1c4758a40ecc907aecc2b9` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.317720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=075b622bcb1c4758a40ecc907aecc2b9)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:46.319398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:46.446749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075b622bcb1c4758a40ecc907aecc2b9', 'request_id': 'req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:46.573372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c581bd-c832-476d-836c-04c6e38e549e None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.573658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c581bd-c832-476d-836c-04c6e38e549e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.573933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c581bd-c832-476d-836c-04c6e38e549e None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.575329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1085/2143] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 15:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:59:46.579980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711963-7b4d-4f94-8bdf-300bb668ba5b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.580268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711963-7b4d-4f94-8bdf-300bb668ba5b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.580603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711963-7b4d-4f94-8bdf-300bb668ba5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.598821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075b622bcb1c4758a40ecc907aecc2b9', 'request_id': 'req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:46.603070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-db711963-7b4d-4f94-8bdf-300bb668ba5b None None] MFA Rules not processed for user `90324fa56d0743699f2fddd17fb630dd`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:46.604312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-db711963-7b4d-4f94-8bdf-300bb668ba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:46.606518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075b622bcb1c4758a40ecc907aecc2b9', 'request_id': 'req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:46.618370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] The token cache is being invalidate because project 075b622bcb1c4758a40ecc907aecc2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:59:46.618739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:46.619385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0d1c89e2-bd5b-44cd-aafb-b0c3b106e387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:59:46.620929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1059/2144] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 15:59:46 2022] DELETE /identity/v3/projects/075b622bcb1c4758a40ecc907aecc2b9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:59:46.625644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff47ff-46f6-417d-ab8f-23081675ba1a None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.625920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff47ff-46f6-417d-ab8f-23081675ba1a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.626189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff47ff-46f6-417d-ab8f-23081675ba1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.652500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d4ff47ff-46f6-417d-ab8f-23081675ba1a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:46.653774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d4ff47ff-46f6-417d-ab8f-23081675ba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:46.663434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1086/2145] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:59:46.675480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711963-7b4d-4f94-8bdf-300bb668ba5b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:46.677652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-db711963-7b4d-4f94-8bdf-300bb668ba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:46.691468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db711963-7b4d-4f94-8bdf-300bb668ba5b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:46.695555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6353-d76d-4695-a83b-d6213bc2bf8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:46.696312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6353-d76d-4695-a83b-d6213bc2bf8a service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.696735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6353-d76d-4695-a83b-d6213bc2bf8a service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.697082 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6353-d76d-4695-a83b-d6213bc2bf8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.707080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6353-d76d-4695-a83b-d6213bc2bf8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:46.709025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6353-d76d-4695-a83b-d6213bc2bf8a service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:46.722295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1087/2146] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:59:46.730026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1060/2147] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:59:46.739980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195f5d-cf85-4920-834d-6565418e0d3e None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.740492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195f5d-cf85-4920-834d-6565418e0d3e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.740891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34195f5d-cf85-4920-834d-6565418e0d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.769635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-34195f5d-cf85-4920-834d-6565418e0d3e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:46.771104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-34195f5d-cf85-4920-834d-6565418e0d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:46.788549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1088/2148] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:46.790028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff47ff-46f6-417d-ab8f-23081675ba1a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:46.806774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff47ff-46f6-417d-ab8f-23081675ba1a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:46.816457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:46.816847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9199b47-7c95-4627-b426-4b5375d76de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:46.816847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9199b47-7c95-4627-b426-4b5375d76de7 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.816847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9199b47-7c95-4627-b426-4b5375d76de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.817190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9199b47-7c95-4627-b426-4b5375d76de7 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.817822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9199b47-7c95-4627-b426-4b5375d76de7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:59:46.818222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9199b47-7c95-4627-b426-4b5375d76de7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:46.819922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9199b47-7c95-4627-b426-4b5375d76de7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:46.834978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1061/2149] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 15:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:59:46.839436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195f5d-cf85-4920-834d-6565418e0d3e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:46.850922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34195f5d-cf85-4920-834d-6565418e0d3e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:46.857057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefe198-2c85-4c5b-a6fa-17b14877feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:46.857776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefe198-2c85-4c5b-a6fa-17b14877feb8 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.858129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefe198-2c85-4c5b-a6fa-17b14877feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.858472 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefe198-2c85-4c5b-a6fa-17b14877feb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.859307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefe198-2c85-4c5b-a6fa-17b14877feb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:46.861390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefe198-2c85-4c5b-a6fa-17b14877feb8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:46.867529 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6aa14-a64c-4eb0-a3da-9a17925078fe None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.867920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6aa14-a64c-4eb0-a3da-9a17925078fe None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.868312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6aa14-a64c-4eb0-a3da-9a17925078fe None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.870376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1062/2150] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 15:59:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:59:46.877026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4202b4c-eb23-4690-8894-85bf3c7d197d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:46.877915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4202b4c-eb23-4690-8894-85bf3c7d197d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:46.879046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4202b4c-eb23-4690-8894-85bf3c7d197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:46.944148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c4202b4c-eb23-4690-8894-85bf3c7d197d None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:46.945619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c4202b4c-eb23-4690-8894-85bf3c7d197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:47.031838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1089/2151] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 15:59:46 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:59:47.036252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefe198-2c85-4c5b-a6fa-17b14877feb8 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:47.080767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1063/2152] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:59:47.095934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4202b4c-eb23-4690-8894-85bf3c7d197d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:47.097733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c4202b4c-eb23-4690-8894-85bf3c7d197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:47.129145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4202b4c-eb23-4690-8894-85bf3c7d197d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:47.142559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefe198-2c85-4c5b-a6fa-17b14877feb8 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:47.148323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e02a-e35b-4ad6-a8a4-3fa0e7ecab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:47.150446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e02a-e35b-4ad6-a8a4-3fa0e7ecab18 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:47.150739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e02a-e35b-4ad6-a8a4-3fa0e7ecab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:47.155217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73e02a-e35b-4ad6-a8a4-3fa0e7ecab18 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:47.155217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73e02a-e35b-4ad6-a8a4-3fa0e7ecab18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:47.155217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73e02a-e35b-4ad6-a8a4-3fa0e7ecab18 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:47.210806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b089-547c-439f-8618-babbf235c500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:47.211162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b089-547c-439f-8618-babbf235c500 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:47.211440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b089-547c-439f-8618-babbf235c500 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:47.211713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24b089-547c-439f-8618-babbf235c500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:47.281591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1090/2153] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 15:59:47 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:59:47.285911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e02a-e35b-4ad6-a8a4-3fa0e7ecab18 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:47.297431 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73e02a-e35b-4ad6-a8a4-3fa0e7ecab18 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:47.303242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e831-8f49-484d-9de8-b062c6c176c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:47.303859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e831-8f49-484d-9de8-b062c6c176c5 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:47.304139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e831-8f49-484d-9de8-b062c6c176c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:47.304409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e831-8f49-484d-9de8-b062c6c176c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:47.305717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e831-8f49-484d-9de8-b062c6c176c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:47.307367 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e831-8f49-484d-9de8-b062c6c176c5 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:47.308766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24b089-547c-439f-8618-babbf235c500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:47.310107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24b089-547c-439f-8618-babbf235c500 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:47.319841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1091/2154] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:59:47.322114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1064/2155] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:59:47.324349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e831-8f49-484d-9de8-b062c6c176c5 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:47.337005 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e831-8f49-484d-9de8-b062c6c176c5 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:47.342186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c715e5d-4f72-4802-9163-613b96d4e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:47.350188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715e5d-4f72-4802-9163-613b96d4e398 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:47.350188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715e5d-4f72-4802-9163-613b96d4e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:47.350188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715e5d-4f72-4802-9163-613b96d4e398 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:47.350188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c715e5d-4f72-4802-9163-613b96d4e398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:47.350188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c715e5d-4f72-4802-9163-613b96d4e398 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:47.363628 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1092/2156] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 15:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:59:47.364809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b089-547c-439f-8618-babbf235c500 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:47.381002 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24b089-547c-439f-8618-babbf235c500 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:47.392071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc987e4-26fc-4acb-b977-afc20f13f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:47.392811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc987e4-26fc-4acb-b977-afc20f13f2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:47.393095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc987e4-26fc-4acb-b977-afc20f13f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:47.393364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc987e4-26fc-4acb-b977-afc20f13f2b6 admin admin] PATH_INFO: `/v3/projects/4a3fb62fb5b44c61aaf868f359a4e2fc/users/eb8cebc212014e92b6e59ed133f32b39/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:47.411553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc987e4-26fc-4acb-b977-afc20f13f2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a3fb62fb5b44c61aaf868f359a4e2fc, user_id=eb8cebc212014e92b6e59ed133f32b39, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:47.414497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc987e4-26fc-4acb-b977-afc20f13f2b6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:47.539409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1065/2157] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 15:59:47 2022] PUT /identity/v3/projects/4a3fb62fb5b44c61aaf868f359a4e2fc/users/eb8cebc212014e92b6e59ed133f32b39/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:59:47.549942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b6da-e3c1-44ae-831a-edab267f51e2 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:47.550414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b6da-e3c1-44ae-831a-edab267f51e2 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:47.550752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b6da-e3c1-44ae-831a-edab267f51e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:47.580280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d961b6da-e3c1-44ae-831a-edab267f51e2 None None] MFA Rules not processed for user `eb8cebc212014e92b6e59ed133f32b39`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:47.582154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d961b6da-e3c1-44ae-831a-edab267f51e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:47.650478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1093/2158] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:47.662038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc987e4-26fc-4acb-b977-afc20f13f2b6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:47.663742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ecc987e4-26fc-4acb-b977-afc20f13f2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:47.726265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc987e4-26fc-4acb-b977-afc20f13f2b6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:47.729959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622cc7f-fd81-455c-98eb-43298ad1b14f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:47.730622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622cc7f-fd81-455c-98eb-43298ad1b14f service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:47.730904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622cc7f-fd81-455c-98eb-43298ad1b14f service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:47.731179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622cc7f-fd81-455c-98eb-43298ad1b14f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:47.739525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622cc7f-fd81-455c-98eb-43298ad1b14f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:47.746531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622cc7f-fd81-455c-98eb-43298ad1b14f service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:47.749957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1066/2159] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 15:59:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:59:49.383028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:49.542369 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9b48-662b-42d4-b6f0-b12e8bcf5fef None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:49.542679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9b48-662b-42d4-b6f0-b12e8bcf5fef None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:49.543148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc9b48-662b-42d4-b6f0-b12e8bcf5fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:49.568188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-82cc9b48-662b-42d4-b6f0-b12e8bcf5fef None None] MFA Rules not processed for user `eb8cebc212014e92b6e59ed133f32b39`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:49.569807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-82cc9b48-662b-42d4-b6f0-b12e8bcf5fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:49.580249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1094/2160] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 15:59:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:59:50.125900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:51.719503 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:52.686000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c8c3-30fd-4c7f-b65b-323b497ecb90 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:52.686590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c8c3-30fd-4c7f-b65b-323b497ecb90 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:52.686590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c8c3-30fd-4c7f-b65b-323b497ecb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:52.718937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-aca5c8c3-30fd-4c7f-b65b-323b497ecb90 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:59:52.718937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-aca5c8c3-30fd-4c7f-b65b-323b497ecb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:52.793904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1067/2161] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 15:59:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:59:52.808113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc9b48-662b-42d4-b6f0-b12e8bcf5fef None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:59:52.810029 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-82cc9b48-662b-42d4-b6f0-b12e8bcf5fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:59:52.883086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc9b48-662b-42d4-b6f0-b12e8bcf5fef None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:59:52.891463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:52.898072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00c3db-8881-4c76-a6bd-f46280e380af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:59:52.898929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00c3db-8881-4c76-a6bd-f46280e380af service swift] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:59:52.899389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00c3db-8881-4c76-a6bd-f46280e380af service swift] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:59:52.899806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00c3db-8881-4c76-a6bd-f46280e380af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:59:52.909514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00c3db-8881-4c76-a6bd-f46280e380af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:59:52.911503 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00c3db-8881-4c76-a6bd-f46280e380af service swift] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:59:52.920686 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1095/2162] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 15:59:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 15:59:53.385296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:55.999164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:56.325196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:57.159013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:58.250677 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:59.233640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:59.822229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:01.119368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:01.370530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:02.199301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:02.931231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:06.341275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:08.216351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:08.707729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:11.267674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:11.856387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:13.847106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:14.108986 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:14.490934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:15.696015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:15.844920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:16.605073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:17.844946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:18.908231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:19.923969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:21.516697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd12aa-5987-4cab-9236-cb1614cef6ce None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:21.516697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd12aa-5987-4cab-9236-cb1614cef6ce None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:21.516697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd12aa-5987-4cab-9236-cb1614cef6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:21.535367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-21fd12aa-5987-4cab-9236-cb1614cef6ce None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:21.536658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-21fd12aa-5987-4cab-9236-cb1614cef6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:21.544144 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1068/2163] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:21.560372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00c3db-8881-4c76-a6bd-f46280e380af service swift] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:21.572175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00c3db-8881-4c76-a6bd-f46280e380af service swift] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:21.577826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b022b-114a-4bac-ab2b-81e07b29bb67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:21.578438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b022b-114a-4bac-ab2b-81e07b29bb67 service swift] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:21.578716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b022b-114a-4bac-ab2b-81e07b29bb67 service swift] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:21.578985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b022b-114a-4bac-ab2b-81e07b29bb67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:21.587445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b022b-114a-4bac-ab2b-81e07b29bb67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:21.589084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b022b-114a-4bac-ab2b-81e07b29bb67 service swift] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:21.598170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1096/2164] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:00:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:00:21.605313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59613-894c-47d6-8b0a-8a1c825be591 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:21.605595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59613-894c-47d6-8b0a-8a1c825be591 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:21.606295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c59613-894c-47d6-8b0a-8a1c825be591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:21.643231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-45c59613-894c-47d6-8b0a-8a1c825be591 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:21.644474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-45c59613-894c-47d6-8b0a-8a1c825be591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:21.715671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1069/2165] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:22.086721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b022b-114a-4bac-ab2b-81e07b29bb67 service swift] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:22.088151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c21b022b-114a-4bac-ab2b-81e07b29bb67 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:22.131953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:22.165227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b022b-114a-4bac-ab2b-81e07b29bb67 service swift] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:22.171167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6b88c-3713-4683-be09-7ffc6d23da94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:22.171792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b88c-3713-4683-be09-7ffc6d23da94 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:22.172070 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b88c-3713-4683-be09-7ffc6d23da94 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:22.172341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b88c-3713-4683-be09-7ffc6d23da94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:22.188174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6b88c-3713-4683-be09-7ffc6d23da94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:22.189795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6b88c-3713-4683-be09-7ffc6d23da94 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:22.201717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1097/2166] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:23.228039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:23.599617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:25.346253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c59613-894c-47d6-8b0a-8a1c825be591 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:25.349227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-45c59613-894c-47d6-8b0a-8a1c825be591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:25.419693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c59613-894c-47d6-8b0a-8a1c825be591 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:25.424843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24848f-9851-4648-8587-731156fd0a35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecb4e7e9e3042adadd93229f8456eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:25.425471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24848f-9851-4648-8587-731156fd0a35 service placement] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:25.425794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24848f-9851-4648-8587-731156fd0a35 service placement] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:25.426098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24848f-9851-4648-8587-731156fd0a35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:25.427847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3d24848f-9851-4648-8587-731156fd0a35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:25.440928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24848f-9851-4648-8587-731156fd0a35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:25.443568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24848f-9851-4648-8587-731156fd0a35 service placement] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:25.455155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1070/2167] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:25.588610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:26.142042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:28.525414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:29.313710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:30.544507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:31.056738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d59be0-4f9a-428f-91f9-c79b625c1773 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:31.057203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d59be0-4f9a-428f-91f9-c79b625c1773 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:31.057299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d59be0-4f9a-428f-91f9-c79b625c1773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:31.076879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-76d59be0-4f9a-428f-91f9-c79b625c1773 None None] MFA Rules not processed for user `d630b75517634f6e9cf0613661fb7695`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:31.078442 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-76d59be0-4f9a-428f-91f9-c79b625c1773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:31.148065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1098/2168] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:31.158795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22405afa-8083-4341-80cc-f33c6c00f3ad None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:31.159142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22405afa-8083-4341-80cc-f33c6c00f3ad None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:31.159483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22405afa-8083-4341-80cc-f33c6c00f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:31.184075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-22405afa-8083-4341-80cc-f33c6c00f3ad None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:31.185404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-22405afa-8083-4341-80cc-f33c6c00f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:31.206111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1071/2169] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:31.233823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d59be0-4f9a-428f-91f9-c79b625c1773 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:31.235582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-76d59be0-4f9a-428f-91f9-c79b625c1773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:31.255435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d59be0-4f9a-428f-91f9-c79b625c1773 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:31.261362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfa87-681c-4574-b0a6-81bc080b4258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:31.262197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfa87-681c-4574-b0a6-81bc080b4258 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:31.263268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfa87-681c-4574-b0a6-81bc080b4258 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:31.263709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfa87-681c-4574-b0a6-81bc080b4258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:31.273787 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bfa87-681c-4574-b0a6-81bc080b4258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:31.275380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bfa87-681c-4574-b0a6-81bc080b4258 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:31.285375 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1099/2170] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:31.834351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:32.445857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:33.546259 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:34.607641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8de3a-5c1b-4614-bbb3-77332cdfdf8f None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:34.608247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8de3a-5c1b-4614-bbb3-77332cdfdf8f None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:34.608247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8de3a-5c1b-4614-bbb3-77332cdfdf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:34.628421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a4f8de3a-5c1b-4614-bbb3-77332cdfdf8f None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:34.629662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a4f8de3a-5c1b-4614-bbb3-77332cdfdf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:34.637078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1072/2171] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 16:00:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:34.652189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfa87-681c-4574-b0a6-81bc080b4258 service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:34.673877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfa87-681c-4574-b0a6-81bc080b4258 service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:34.688176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16296aa-5da0-436c-bf70-070a828f0f4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:34.689092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16296aa-5da0-436c-bf70-070a828f0f4f service swift] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:34.689620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16296aa-5da0-436c-bf70-070a828f0f4f service swift] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:34.692364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16296aa-5da0-436c-bf70-070a828f0f4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:34.712158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16296aa-5da0-436c-bf70-070a828f0f4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:34.713819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16296aa-5da0-436c-bf70-070a828f0f4f service swift] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:34.722299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1100/2172] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:00:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 16:00:35.439269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:35.658510 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7052e-0339-4f59-8362-4fe060dead20 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:35.658988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7052e-0339-4f59-8362-4fe060dead20 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:35.659102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7052e-0339-4f59-8362-4fe060dead20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:35.679609 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-34d7052e-0339-4f59-8362-4fe060dead20 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:35.681122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-34d7052e-0339-4f59-8362-4fe060dead20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:35.688939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1073/2173] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 16:00:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:35.700802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16296aa-5da0-436c-bf70-070a828f0f4f service swift] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:35.727861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16296aa-5da0-436c-bf70-070a828f0f4f service swift] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:35.741391 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282f805-7ca5-4335-af38-b919773cbdee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:35.742191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f805-7ca5-4335-af38-b919773cbdee service swift] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:35.742622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f805-7ca5-4335-af38-b919773cbdee service swift] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:35.743226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f805-7ca5-4335-af38-b919773cbdee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:35.754927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282f805-7ca5-4335-af38-b919773cbdee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:35.757262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282f805-7ca5-4335-af38-b919773cbdee service swift] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:35.769905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1101/2174] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:00:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:00:36.206009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00777c4e-ce74-473d-96ba-2761dfcfe9db None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:36.206630 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00777c4e-ce74-473d-96ba-2761dfcfe9db None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:36.207892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00777c4e-ce74-473d-96ba-2761dfcfe9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:36.240664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-00777c4e-ce74-473d-96ba-2761dfcfe9db None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:36.242097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-00777c4e-ce74-473d-96ba-2761dfcfe9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:36.250484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1074/2175] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 16:00:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:36.265025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282f805-7ca5-4335-af38-b919773cbdee service swift] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:36.281959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282f805-7ca5-4335-af38-b919773cbdee service swift] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:36.293136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870bea3-bf2a-4e8c-943c-b2c3fc9bcc19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:36.294141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870bea3-bf2a-4e8c-943c-b2c3fc9bcc19 service swift] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:36.294614 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870bea3-bf2a-4e8c-943c-b2c3fc9bcc19 service swift] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:36.295075 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870bea3-bf2a-4e8c-943c-b2c3fc9bcc19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:36.305059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870bea3-bf2a-4e8c-943c-b2c3fc9bcc19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:36.307482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870bea3-bf2a-4e8c-943c-b2c3fc9bcc19 service swift] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:36.321765 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1102/2176] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:00:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:00:36.331160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:37.119213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ab693-a881-410a-93ed-e41a2add8104 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:37.119213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ab693-a881-410a-93ed-e41a2add8104 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:37.119213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ab693-a881-410a-93ed-e41a2add8104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:37.149045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c58ab693-a881-410a-93ed-e41a2add8104 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:37.150697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c58ab693-a881-410a-93ed-e41a2add8104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:37.163131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1075/2177] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:37.177856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870bea3-bf2a-4e8c-943c-b2c3fc9bcc19 service swift] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:37.194688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870bea3-bf2a-4e8c-943c-b2c3fc9bcc19 service swift] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:37.215078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2044d6-9ec0-4727-922a-c94825fe6dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:37.216386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2044d6-9ec0-4727-922a-c94825fe6dfe service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:37.216955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2044d6-9ec0-4727-922a-c94825fe6dfe service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:37.217412 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2044d6-9ec0-4727-922a-c94825fe6dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:37.229755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2044d6-9ec0-4727-922a-c94825fe6dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:37.232006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2044d6-9ec0-4727-922a-c94825fe6dfe service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:37.251346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1103/2178] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:37.352049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52dc0c-6bed-4b79-a320-774c6b07efe0 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:37.352341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52dc0c-6bed-4b79-a320-774c6b07efe0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:37.352840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52dc0c-6bed-4b79-a320-774c6b07efe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:37.382800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4f52dc0c-6bed-4b79-a320-774c6b07efe0 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:37.384200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4f52dc0c-6bed-4b79-a320-774c6b07efe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:37.398326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1076/2179] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:37.419721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2044d6-9ec0-4727-922a-c94825fe6dfe service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:37.452839 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2044d6-9ec0-4727-922a-c94825fe6dfe service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:37.492308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8955e-66e5-406e-8d59-b8e8c3658f2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:37.493018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8955e-66e5-406e-8d59-b8e8c3658f2b service swift] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:37.493295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8955e-66e5-406e-8d59-b8e8c3658f2b service swift] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:37.493566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8955e-66e5-406e-8d59-b8e8c3658f2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:37.519223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8955e-66e5-406e-8d59-b8e8c3658f2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:37.521369 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8955e-66e5-406e-8d59-b8e8c3658f2b service swift] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:37.538451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1104/2180] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:00:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:00:38.571005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:38.583463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979f783-f278-4ece-84d5-99b6a37d6cf9 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:38.583736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979f783-f278-4ece-84d5-99b6a37d6cf9 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:38.586809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979f783-f278-4ece-84d5-99b6a37d6cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:38.613426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b979f783-f278-4ece-84d5-99b6a37d6cf9 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:38.616068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b979f783-f278-4ece-84d5-99b6a37d6cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:38.625568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1077/2181] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 16:00:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:38.652016 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8955e-66e5-406e-8d59-b8e8c3658f2b service swift] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:38.667048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8955e-66e5-406e-8d59-b8e8c3658f2b service swift] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:38.679197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be7389-748a-47a6-a474-b6fe9d78a18a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:38.680485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be7389-748a-47a6-a474-b6fe9d78a18a service swift] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:38.681169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be7389-748a-47a6-a474-b6fe9d78a18a service swift] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:38.681612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be7389-748a-47a6-a474-b6fe9d78a18a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:38.701522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be7389-748a-47a6-a474-b6fe9d78a18a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:38.703445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be7389-748a-47a6-a474-b6fe9d78a18a service swift] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:38.713674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1105/2182] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:00:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:00:39.629080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:41.886985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc331b2-74b1-422c-953a-bbb0f549efbd None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:41.887419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc331b2-74b1-422c-953a-bbb0f549efbd None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:41.887562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc331b2-74b1-422c-953a-bbb0f549efbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:41.913838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7dc331b2-74b1-422c-953a-bbb0f549efbd None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:41.915590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7dc331b2-74b1-422c-953a-bbb0f549efbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:41.932643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1078/2183] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:41.951152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be7389-748a-47a6-a474-b6fe9d78a18a service swift] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:41.964434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be7389-748a-47a6-a474-b6fe9d78a18a service swift] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:41.979813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b831a-6c59-43fc-99d6-664bbd8dbb6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:41.982976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959ef5e-ef13-48e2-8918-a256cff3cdff None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:41.984655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b831a-6c59-43fc-99d6-664bbd8dbb6b service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:41.985019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959ef5e-ef13-48e2-8918-a256cff3cdff None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:41.985458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959ef5e-ef13-48e2-8918-a256cff3cdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:41.985771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b831a-6c59-43fc-99d6-664bbd8dbb6b service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:41.987469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b831a-6c59-43fc-99d6-664bbd8dbb6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:42.008093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b831a-6c59-43fc-99d6-664bbd8dbb6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:42.011012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b831a-6c59-43fc-99d6-664bbd8dbb6b service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:42.016705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3959ef5e-ef13-48e2-8918-a256cff3cdff None None] MFA Rules not processed for user `1e513898018544c7924d592c40f7dd54`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:42.018201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3959ef5e-ef13-48e2-8918-a256cff3cdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:42.024651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1106/2184] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:00:42.063679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:42.110108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1079/2185] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:42.416706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:42.447703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b831a-6c59-43fc-99d6-664bbd8dbb6b service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:42.464409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b831a-6c59-43fc-99d6-664bbd8dbb6b service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:42.481101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:42.482015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:42.482166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:42.482468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] PATH_INFO: `/v3/users/eb8cebc212014e92b6e59ed133f32b39` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:42.483820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8cebc212014e92b6e59ed133f32b39)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:42.486357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:42.771294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:42.859913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8cebc212014e92b6e59ed133f32b39'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:00:42.893384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8cebc212014e92b6e59ed133f32b39'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:00:43.227373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8cebc212014e92b6e59ed133f32b39'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:00:43.229585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8cebc212014e92b6e59ed133f32b39'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:00:43.229585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8cebc212014e92b6e59ed133f32b39'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:00:43.247083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1107/2186] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:00:42 2022] DELETE /identity/v3/users/eb8cebc212014e92b6e59ed133f32b39 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:00:43.251718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aabba5-3fd0-43c1-9097-5c42a9d7db0e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:43.253102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aabba5-3fd0-43c1-9097-5c42a9d7db0e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:43.253102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aabba5-3fd0-43c1-9097-5c42a9d7db0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:43.272333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-98aabba5-3fd0-43c1-9097-5c42a9d7db0e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:43.273907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-98aabba5-3fd0-43c1-9097-5c42a9d7db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:43.357236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1080/2187] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:43.365884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:43.368261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:43.502172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce18d3-80a2-4416-aaec-1211e3c7a886 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:43.507835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269c2cc-0c8b-4601-bcb6-0ce99613f0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:43.508579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269c2cc-0c8b-4601-bcb6-0ce99613f0eb service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:43.508936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269c2cc-0c8b-4601-bcb6-0ce99613f0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:43.509278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269c2cc-0c8b-4601-bcb6-0ce99613f0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:43.519633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269c2cc-0c8b-4601-bcb6-0ce99613f0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:43.524094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269c2cc-0c8b-4601-bcb6-0ce99613f0eb service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:43.538322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1108/2188] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:43.892913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aabba5-3fd0-43c1-9097-5c42a9d7db0e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:43.896170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-98aabba5-3fd0-43c1-9097-5c42a9d7db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:43.937446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aabba5-3fd0-43c1-9097-5c42a9d7db0e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:43.976598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:43.977806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:43.979014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:43.979408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] PATH_INFO: `/v3/projects/4a3fb62fb5b44c61aaf868f359a4e2fc` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:43.988936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a3fb62fb5b44c61aaf868f359a4e2fc)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:43.992767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:44.266432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a3fb62fb5b44c61aaf868f359a4e2fc', 'request_id': 'req-f03a1789-3e2a-4159-8af0-abe9635f4389'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:00:44.374854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a3fb62fb5b44c61aaf868f359a4e2fc', 'request_id': 'req-f03a1789-3e2a-4159-8af0-abe9635f4389'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:00:44.386418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a3fb62fb5b44c61aaf868f359a4e2fc', 'request_id': 'req-f03a1789-3e2a-4159-8af0-abe9635f4389'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:00:44.399822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] The token cache is being invalidate because project 4a3fb62fb5b44c61aaf868f359a4e2fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:00:44.400501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:00:44.401271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:00:44.403050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1081/2189] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:00:43 2022] DELETE /identity/v3/projects/4a3fb62fb5b44c61aaf868f359a4e2fc => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:00:46.350104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7905f69-021c-4336-956c-08fe513ecb5e None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:46.350664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7905f69-021c-4336-956c-08fe513ecb5e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:46.350664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7905f69-021c-4336-956c-08fe513ecb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:46.372382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-a7905f69-021c-4336-956c-08fe513ecb5e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:46.373724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a7905f69-021c-4336-956c-08fe513ecb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:46.441891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1109/2190] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:46.458466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:46.460349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:46.545095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a1789-3e2a-4159-8af0-abe9635f4389 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:46.551784 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3616f5-181e-465b-9891-9c3326a729d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:46.552390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3616f5-181e-465b-9891-9c3326a729d1 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:46.552711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3616f5-181e-465b-9891-9c3326a729d1 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:46.552982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3616f5-181e-465b-9891-9c3326a729d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:46.563322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3616f5-181e-465b-9891-9c3326a729d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:46.565040 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3616f5-181e-465b-9891-9c3326a729d1 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:46.575700 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1082/2191] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:00:46.761873 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:47.233495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:48.251170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:49.238993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:50.250947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:50.812769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:51.114003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:51.825484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec0d5c-a491-4c32-aa06-caea790c2027 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:51.825484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec0d5c-a491-4c32-aa06-caea790c2027 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:51.825484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec0d5c-a491-4c32-aa06-caea790c2027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:51.854022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e5ec0d5c-a491-4c32-aa06-caea790c2027 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:51.865362 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e5ec0d5c-a491-4c32-aa06-caea790c2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:51.874769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1110/2192] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:51.889535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3616f5-181e-465b-9891-9c3326a729d1 service nova] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:51.893931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-da3616f5-181e-465b-9891-9c3326a729d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:51.905972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3616f5-181e-465b-9891-9c3326a729d1 service nova] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:51.913012 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed42f35-895e-433d-821f-fae93a9121b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:51.913666 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed42f35-895e-433d-821f-fae93a9121b4 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:51.913944 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed42f35-895e-433d-821f-fae93a9121b4 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:51.914213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed42f35-895e-433d-821f-fae93a9121b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:51.923234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed42f35-895e-433d-821f-fae93a9121b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:51.925131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed42f35-895e-433d-821f-fae93a9121b4 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:51.936367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1083/2193] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:52.143200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:52.382009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:53.142134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:53.868035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:54.976033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:55.285014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9312219-3fc3-4f90-9bf3-0676dbb69c47 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:55.285956 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9312219-3fc3-4f90-9bf3-0676dbb69c47 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:55.286262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9312219-3fc3-4f90-9bf3-0676dbb69c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:55.308948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e9312219-3fc3-4f90-9bf3-0676dbb69c47 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:55.309394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e9312219-3fc3-4f90-9bf3-0676dbb69c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:55.364695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1111/2194] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 16:00:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:55.377006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed42f35-895e-433d-821f-fae93a9121b4 service nova] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:55.378440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3ed42f35-895e-433d-821f-fae93a9121b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:55.448338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed42f35-895e-433d-821f-fae93a9121b4 service nova] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:55.453513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83435b47-be58-4a32-9ab7-23f194958590 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:55.454322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435b47-be58-4a32-9ab7-23f194958590 service swift] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:55.454597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435b47-be58-4a32-9ab7-23f194958590 service swift] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:55.454868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83435b47-be58-4a32-9ab7-23f194958590 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:55.464295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83435b47-be58-4a32-9ab7-23f194958590 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:55.466030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83435b47-be58-4a32-9ab7-23f194958590 service swift] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:55.474373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1084/2195] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:00:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:00:56.593541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:58.695837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:00.024125 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9312219-3fc3-4f90-9bf3-0676dbb69c47 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:00.025638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e9312219-3fc3-4f90-9bf3-0676dbb69c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:00.040145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9312219-3fc3-4f90-9bf3-0676dbb69c47 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:00.044812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:00.045469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:00.045747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:00.046018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] PATH_INFO: `/v3/users/977c9ce3a61445fab584d7a551e4e93d` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:00.047165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977c9ce3a61445fab584d7a551e4e93d)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:00.049127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:00.299521 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977c9ce3a61445fab584d7a551e4e93d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:00.308661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977c9ce3a61445fab584d7a551e4e93d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:00.393213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977c9ce3a61445fab584d7a551e4e93d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:00.393957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977c9ce3a61445fab584d7a551e4e93d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:00.394721 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2740b8bf-12d4-44c2-b09d-d12f0b59cf25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977c9ce3a61445fab584d7a551e4e93d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:00.420897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1112/2196] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:01:00 2022] DELETE /identity/v3/users/977c9ce3a61445fab584d7a551e4e93d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:01:00.570498 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:00.725698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83435b47-be58-4a32-9ab7-23f194958590 service swift] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:00.736821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83435b47-be58-4a32-9ab7-23f194958590 service swift] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:00.796943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:00.797587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:00.797869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:00.798138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] PATH_INFO: `/v3/projects/6fcfa2e6b8634f80a3ad05e50979c808` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:00.799267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fcfa2e6b8634f80a3ad05e50979c808)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:00.801933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:01.005389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcfa2e6b8634f80a3ad05e50979c808', 'request_id': 'req-5548d4f1-00a6-479c-a43e-57d3d5121297'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:01.107372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:01.153150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcfa2e6b8634f80a3ad05e50979c808', 'request_id': 'req-5548d4f1-00a6-479c-a43e-57d3d5121297'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:01.161119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcfa2e6b8634f80a3ad05e50979c808', 'request_id': 'req-5548d4f1-00a6-479c-a43e-57d3d5121297'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:01.171558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] The token cache is being invalidate because project 6fcfa2e6b8634f80a3ad05e50979c808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:01:01.171846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:01.172493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5548d4f1-00a6-479c-a43e-57d3d5121297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:01.174030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1085/2197] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:01:00 2022] DELETE /identity/v3/projects/6fcfa2e6b8634f80a3ad05e50979c808 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:01:01.178952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9b7a-7cf9-4b5e-95eb-e5d05069ed75 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:01.179248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9b7a-7cf9-4b5e-95eb-e5d05069ed75 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:01.179522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e9b7a-7cf9-4b5e-95eb-e5d05069ed75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:01.199349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-763e9b7a-7cf9-4b5e-95eb-e5d05069ed75 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:01.200599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-763e9b7a-7cf9-4b5e-95eb-e5d05069ed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:01.259934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1113/2198] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:01.267615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e79b3-1143-46f2-a2d6-a9e506c98153 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:01.267901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e79b3-1143-46f2-a2d6-a9e506c98153 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:01.268179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e79b3-1143-46f2-a2d6-a9e506c98153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:01.288759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-930e79b3-1143-46f2-a2d6-a9e506c98153 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:01.289968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-930e79b3-1143-46f2-a2d6-a9e506c98153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:01.297872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1086/2199] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:01.302272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e9b7a-7cf9-4b5e-95eb-e5d05069ed75 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:01.312401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e9b7a-7cf9-4b5e-95eb-e5d05069ed75 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:01.320202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46625fff-0fab-447c-a4fa-2003a3ce77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:01.321970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46625fff-0fab-447c-a4fa-2003a3ce77c5 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:01.321970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46625fff-0fab-447c-a4fa-2003a3ce77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:01.321970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46625fff-0fab-447c-a4fa-2003a3ce77c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:01.322242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46625fff-0fab-447c-a4fa-2003a3ce77c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:01:01.322436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46625fff-0fab-447c-a4fa-2003a3ce77c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:01.324156 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46625fff-0fab-447c-a4fa-2003a3ce77c5 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:01.342678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1114/2200] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:01:01.346907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e79b3-1143-46f2-a2d6-a9e506c98153 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:01.357712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e79b3-1143-46f2-a2d6-a9e506c98153 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:01.362457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107dbf7-27c1-4afa-9b23-add2cefeb9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:01.363247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107dbf7-27c1-4afa-9b23-add2cefeb9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:01.363527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107dbf7-27c1-4afa-9b23-add2cefeb9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:01.363816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107dbf7-27c1-4afa-9b23-add2cefeb9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:01.364434 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107dbf7-27c1-4afa-9b23-add2cefeb9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:01.366375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107dbf7-27c1-4afa-9b23-add2cefeb9b3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:01.525833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1087/2201] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:01:01 2022] POST /identity/v3/projects => generated 369 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:01:01.530887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46625fff-0fab-447c-a4fa-2003a3ce77c5 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:01.541032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46625fff-0fab-447c-a4fa-2003a3ce77c5 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:01.602540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e67db6-2cab-405b-9e26-333480412203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:01.603154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67db6-2cab-405b-9e26-333480412203 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:01.603430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67db6-2cab-405b-9e26-333480412203 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:01.603701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67db6-2cab-405b-9e26-333480412203 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:01.604379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e67db6-2cab-405b-9e26-333480412203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:01.606575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e67db6-2cab-405b-9e26-333480412203 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:01.730099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1115/2202] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:01:01 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:01:01.737211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107dbf7-27c1-4afa-9b23-add2cefeb9b3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:01.748029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107dbf7-27c1-4afa-9b23-add2cefeb9b3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:01.753181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d752c-4450-47eb-ba40-1c61cf426a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:01.754429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d752c-4450-47eb-ba40-1c61cf426a78 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:01.754681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d752c-4450-47eb-ba40-1c61cf426a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:01.754921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d752c-4450-47eb-ba40-1c61cf426a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:01.755567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d752c-4450-47eb-ba40-1c61cf426a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:01.757449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d752c-4450-47eb-ba40-1c61cf426a78 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:01.767422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1088/2203] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:01:01.771655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e67db6-2cab-405b-9e26-333480412203 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:01.782473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e67db6-2cab-405b-9e26-333480412203 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:01.787712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7b840-4b6f-4984-bd95-9e3fec0a4ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:01.788323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7b840-4b6f-4984-bd95-9e3fec0a4ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:01.788641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7b840-4b6f-4984-bd95-9e3fec0a4ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:01.788919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7b840-4b6f-4984-bd95-9e3fec0a4ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:01.790579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7b840-4b6f-4984-bd95-9e3fec0a4ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:01.792771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7b840-4b6f-4984-bd95-9e3fec0a4ae3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:01.804835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1116/2204] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:01:01.809423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d752c-4450-47eb-ba40-1c61cf426a78 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:01.820650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d752c-4450-47eb-ba40-1c61cf426a78 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:01.825238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67c628-1a1e-4619-a2ea-aa18f1ad85fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:01.825917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67c628-1a1e-4619-a2ea-aa18f1ad85fe admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:01.826195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67c628-1a1e-4619-a2ea-aa18f1ad85fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:01.826495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67c628-1a1e-4619-a2ea-aa18f1ad85fe admin admin] PATH_INFO: `/v3/projects/0de9156977d74b9cb35d7c9d68a22a99/users/303a9ffd78b341b682c84fdf29755ebb/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:01.839264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:01.843118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67c628-1a1e-4619-a2ea-aa18f1ad85fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de9156977d74b9cb35d7c9d68a22a99, user_id=303a9ffd78b341b682c84fdf29755ebb, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:01.845883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67c628-1a1e-4619-a2ea-aa18f1ad85fe admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:02.008763 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1089/2205] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:01:01 2022] PUT /identity/v3/projects/0de9156977d74b9cb35d7c9d68a22a99/users/303a9ffd78b341b682c84fdf29755ebb/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:01:02.018880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d60e2-7507-4c84-83d5-ecee7ae5a6b9 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:02.019169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d60e2-7507-4c84-83d5-ecee7ae5a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:02.019444 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d60e2-7507-4c84-83d5-ecee7ae5a6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:02.047066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-061d60e2-7507-4c84-83d5-ecee7ae5a6b9 None None] MFA Rules not processed for user `303a9ffd78b341b682c84fdf29755ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:02.048235 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-061d60e2-7507-4c84-83d5-ecee7ae5a6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:02.116448 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1117/2206] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:02.127927 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67c628-1a1e-4619-a2ea-aa18f1ad85fe admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:02.129681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6b67c628-1a1e-4619-a2ea-aa18f1ad85fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:02.186780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67c628-1a1e-4619-a2ea-aa18f1ad85fe admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:02.188971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:02.192022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af913d3-31e6-4298-b3af-948029cb238d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2de83ba29194578a9a229d5bab6612e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:02.192654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af913d3-31e6-4298-b3af-948029cb238d service glance] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:02.192954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af913d3-31e6-4298-b3af-948029cb238d service glance] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:02.193220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af913d3-31e6-4298-b3af-948029cb238d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:02.205110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af913d3-31e6-4298-b3af-948029cb238d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:02.205110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af913d3-31e6-4298-b3af-948029cb238d service glance] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:02.211573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1090/2207] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:01:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:03.827476 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:04.375743 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:05.592895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:07.507618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:09.695894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:13.387234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:14.813354 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f6db-086f-40bf-8141-c48b309bf52f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:14.814697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f6db-086f-40bf-8141-c48b309bf52f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:14.814697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377f6db-086f-40bf-8141-c48b309bf52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:14.843601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-a377f6db-086f-40bf-8141-c48b309bf52f None None] MFA Rules not processed for user `e031381744f54bd38e0ea250f0e3abd1`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:14.845517 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a377f6db-086f-40bf-8141-c48b309bf52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:14.927800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1118/2208] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:15.021850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:15.820983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:16.211708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:17.422361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:24.917361 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:26.770286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb316d-42df-427a-b3c7-b3ed205fa5d6 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:26.770813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb316d-42df-427a-b3c7-b3ed205fa5d6 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:26.771004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb316d-42df-427a-b3c7-b3ed205fa5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:26.792844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-91bb316d-42df-427a-b3c7-b3ed205fa5d6 None None] MFA Rules not processed for user `511ddb50fc25452fac22ed8396542f96`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:26.794276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-91bb316d-42df-427a-b3c7-b3ed205fa5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:26.814465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:26.866014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1091/2209] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:30.648207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377f6db-086f-40bf-8141-c48b309bf52f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:30.734862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377f6db-086f-40bf-8141-c48b309bf52f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:30.911041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:30.911041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:30.911041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:30.911041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] PATH_INFO: `/v3/users/303a9ffd78b341b682c84fdf29755ebb` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:30.912578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=303a9ffd78b341b682c84fdf29755ebb)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:30.912578 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:31.072292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303a9ffd78b341b682c84fdf29755ebb'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:31.084483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303a9ffd78b341b682c84fdf29755ebb'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:31.181551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303a9ffd78b341b682c84fdf29755ebb'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:31.182439 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303a9ffd78b341b682c84fdf29755ebb'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:31.183212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303a9ffd78b341b682c84fdf29755ebb'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:31.207052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1119/2210] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:01:30 2022] DELETE /identity/v3/users/303a9ffd78b341b682c84fdf29755ebb => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:01:31.211473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d44b1-5d26-44cb-b014-3d9314f4c34e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:31.212002 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d44b1-5d26-44cb-b014-3d9314f4c34e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:31.212002 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d44b1-5d26-44cb-b014-3d9314f4c34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:31.233543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-c34d44b1-5d26-44cb-b014-3d9314f4c34e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:31.235105 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c34d44b1-5d26-44cb-b014-3d9314f4c34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:31.334831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1092/2211] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:31.357765 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:31.360002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:31.421639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123712c9-c398-49bd-989a-97528761f6c3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:31.431377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4dbd9-df3d-4bc0-b61b-a169a07da062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:31.432602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4dbd9-df3d-4bc0-b61b-a169a07da062 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:31.432602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4dbd9-df3d-4bc0-b61b-a169a07da062 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:31.432808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4dbd9-df3d-4bc0-b61b-a169a07da062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:31.444794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4dbd9-df3d-4bc0-b61b-a169a07da062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:31.446247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4dbd9-df3d-4bc0-b61b-a169a07da062 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:31.457748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1120/2212] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:32.108441 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d44b1-5d26-44cb-b014-3d9314f4c34e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:32.110494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c34d44b1-5d26-44cb-b014-3d9314f4c34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:32.126983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d44b1-5d26-44cb-b014-3d9314f4c34e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:32.137073 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:32.137802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:32.138152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:32.138495 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] PATH_INFO: `/v3/projects/0de9156977d74b9cb35d7c9d68a22a99` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:32.139823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de9156977d74b9cb35d7c9d68a22a99)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:32.142025 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:32.321607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de9156977d74b9cb35d7c9d68a22a99', 'request_id': 'req-e45b0103-cdef-4401-a0cc-ef8650c32d2f'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:32.432652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de9156977d74b9cb35d7c9d68a22a99', 'request_id': 'req-e45b0103-cdef-4401-a0cc-ef8650c32d2f'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:32.439734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de9156977d74b9cb35d7c9d68a22a99', 'request_id': 'req-e45b0103-cdef-4401-a0cc-ef8650c32d2f'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:32.451540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] The token cache is being invalidate because project 0de9156977d74b9cb35d7c9d68a22a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:01:32.451836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:32.452505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e45b0103-cdef-4401-a0cc-ef8650c32d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:32.454061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1093/2213] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:01:32 2022] DELETE /identity/v3/projects/0de9156977d74b9cb35d7c9d68a22a99 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:01:32.459890 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858915e3-ef68-4d67-869e-b33037bf1ae9 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:32.460414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858915e3-ef68-4d67-869e-b33037bf1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:32.460563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858915e3-ef68-4d67-869e-b33037bf1ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:32.480711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-858915e3-ef68-4d67-869e-b33037bf1ae9 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:32.482065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-858915e3-ef68-4d67-869e-b33037bf1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:32.504372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:32.561863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1121/2214] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:32.573222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef1fb-506b-43f3-aca6-f25301a6efa9 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:32.573222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef1fb-506b-43f3-aca6-f25301a6efa9 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:32.573222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef1fb-506b-43f3-aca6-f25301a6efa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:32.592185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-620ef1fb-506b-43f3-aca6-f25301a6efa9 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:32.593443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-620ef1fb-506b-43f3-aca6-f25301a6efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:32.609478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1094/2215] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:32.609580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858915e3-ef68-4d67-869e-b33037bf1ae9 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:32.619339 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858915e3-ef68-4d67-869e-b33037bf1ae9 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:32.624169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc540ab-bf77-4b6a-8c65-e097d5ced0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:32.625346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc540ab-bf77-4b6a-8c65-e097d5ced0ac admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:32.625346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc540ab-bf77-4b6a-8c65-e097d5ced0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:32.626777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc540ab-bf77-4b6a-8c65-e097d5ced0ac admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:32.626777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc540ab-bf77-4b6a-8c65-e097d5ced0ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:01:32.626777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc540ab-bf77-4b6a-8c65-e097d5ced0ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:32.628791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc540ab-bf77-4b6a-8c65-e097d5ced0ac admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:32.641607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1122/2216] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:01:32.645667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef1fb-506b-43f3-aca6-f25301a6efa9 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:32.658018 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef1fb-506b-43f3-aca6-f25301a6efa9 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:32.663440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb69d9-8c60-4bdd-81c0-5f80ac779c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:32.664429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb69d9-8c60-4bdd-81c0-5f80ac779c4c admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:32.665278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb69d9-8c60-4bdd-81c0-5f80ac779c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:32.665776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb69d9-8c60-4bdd-81c0-5f80ac779c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:32.666599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb69d9-8c60-4bdd-81c0-5f80ac779c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:32.669063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb69d9-8c60-4bdd-81c0-5f80ac779c4c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:32.778770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1095/2217] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:01:32 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:01:32.780755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc540ab-bf77-4b6a-8c65-e097d5ced0ac admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:32.796644 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc540ab-bf77-4b6a-8c65-e097d5ced0ac admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:32.874343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f9081-1d56-4123-a3e7-521208999234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:32.875072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f9081-1d56-4123-a3e7-521208999234 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:32.875724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f9081-1d56-4123-a3e7-521208999234 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:32.875724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f9081-1d56-4123-a3e7-521208999234 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:32.877359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f9081-1d56-4123-a3e7-521208999234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:32.879321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f9081-1d56-4123-a3e7-521208999234 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:32.973907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1123/2218] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:01:32 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:01:32.978022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb69d9-8c60-4bdd-81c0-5f80ac779c4c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:32.989391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb69d9-8c60-4bdd-81c0-5f80ac779c4c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:32.994500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4b71a-67f8-4f5f-9953-435c25d6a6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:32.995116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b71a-67f8-4f5f-9953-435c25d6a6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:32.995398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b71a-67f8-4f5f-9953-435c25d6a6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:32.995676 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b71a-67f8-4f5f-9953-435c25d6a6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:32.996335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4b71a-67f8-4f5f-9953-435c25d6a6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:32.997987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4b71a-67f8-4f5f-9953-435c25d6a6b4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:33.008616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1096/2219] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:01:33.012892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f9081-1d56-4123-a3e7-521208999234 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:33.023040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f9081-1d56-4123-a3e7-521208999234 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:33.027723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e98f1-8d22-4e7c-aade-d01207add869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:33.028328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e98f1-8d22-4e7c-aade-d01207add869 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:33.028653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e98f1-8d22-4e7c-aade-d01207add869 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:33.028923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e98f1-8d22-4e7c-aade-d01207add869 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:33.029566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e98f1-8d22-4e7c-aade-d01207add869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:33.031167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e98f1-8d22-4e7c-aade-d01207add869 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:33.045940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1124/2220] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:01:33.047122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4b71a-67f8-4f5f-9953-435c25d6a6b4 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:33.058135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4b71a-67f8-4f5f-9953-435c25d6a6b4 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:33.063160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b3410-a948-4fae-b0a7-b7f8fdc41277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:33.064421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b3410-a948-4fae-b0a7-b7f8fdc41277 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:33.064421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b3410-a948-4fae-b0a7-b7f8fdc41277 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:33.064821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b3410-a948-4fae-b0a7-b7f8fdc41277 admin admin] PATH_INFO: `/v3/projects/2b202820bd9d4a10925a7ec8bec5793a/users/6c52e3b06dcb47e1a950a2929772a19a/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:33.068973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:33.080423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b3410-a948-4fae-b0a7-b7f8fdc41277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b202820bd9d4a10925a7ec8bec5793a, user_id=6c52e3b06dcb47e1a950a2929772a19a, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:33.083540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b3410-a948-4fae-b0a7-b7f8fdc41277 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:33.147505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1097/2221] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:01:33 2022] PUT /identity/v3/projects/2b202820bd9d4a10925a7ec8bec5793a/users/6c52e3b06dcb47e1a950a2929772a19a/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:01:33.158938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f279dc3-be5d-4a67-a95a-46ae0f0832a3 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:33.159722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f279dc3-be5d-4a67-a95a-46ae0f0832a3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:33.159995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f279dc3-be5d-4a67-a95a-46ae0f0832a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:33.190740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3f279dc3-be5d-4a67-a95a-46ae0f0832a3 None None] MFA Rules not processed for user `6c52e3b06dcb47e1a950a2929772a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:33.192086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3f279dc3-be5d-4a67-a95a-46ae0f0832a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:33.273262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1125/2222] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:33.287848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b3410-a948-4fae-b0a7-b7f8fdc41277 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:33.292549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e69b3410-a948-4fae-b0a7-b7f8fdc41277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:33.369899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b3410-a948-4fae-b0a7-b7f8fdc41277 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:33.373880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af02be2-45a6-43d0-a7c5-36783d043a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:33.374568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02be2-45a6-43d0-a7c5-36783d043a1e service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:33.374970 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02be2-45a6-43d0-a7c5-36783d043a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:33.375268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02be2-45a6-43d0-a7c5-36783d043a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:33.386676 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af02be2-45a6-43d0-a7c5-36783d043a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:33.388279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af02be2-45a6-43d0-a7c5-36783d043a1e service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:33.398580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1098/2223] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:01:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:34.411640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402ab3a-3d09-4347-886a-24c9f816b9b5 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:34.412154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402ab3a-3d09-4347-886a-24c9f816b9b5 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:34.412267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402ab3a-3d09-4347-886a-24c9f816b9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:34.431679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-8402ab3a-3d09-4347-886a-24c9f816b9b5 None None] MFA Rules not processed for user `c4415fe3e3704fde82f2dea0622d725f`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:34.433133 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8402ab3a-3d09-4347-886a-24c9f816b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:34.445266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:34.491514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1126/2224] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:34.623568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5a00-c3aa-408b-851e-30b99b1ee3cb None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:34.628546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5a00-c3aa-408b-851e-30b99b1ee3cb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:34.628546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5a00-c3aa-408b-851e-30b99b1ee3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:34.647039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-003b5a00-c3aa-408b-851e-30b99b1ee3cb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:34.648600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-003b5a00-c3aa-408b-851e-30b99b1ee3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:34.715237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1099/2225] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:01:34.732079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402ab3a-3d09-4347-886a-24c9f816b9b5 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:34.733537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8402ab3a-3d09-4347-886a-24c9f816b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:34.821490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402ab3a-3d09-4347-886a-24c9f816b9b5 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:34.827441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b69d5f-3ac8-4697-90b3-ccec09661c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:34.828069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b69d5f-3ac8-4697-90b3-ccec09661c13 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:34.828354 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b69d5f-3ac8-4697-90b3-ccec09661c13 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:34.828664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b69d5f-3ac8-4697-90b3-ccec09661c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:34.837697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b69d5f-3ac8-4697-90b3-ccec09661c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:34.842237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b69d5f-3ac8-4697-90b3-ccec09661c13 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:34.849333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1127/2226] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:39.246636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4fef4-926d-47bf-bd2f-42b3ae284d86 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:39.247160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4fef4-926d-47bf-bd2f-42b3ae284d86 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:39.247160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4fef4-926d-47bf-bd2f-42b3ae284d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:39.303160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-67b4fef4-926d-47bf-bd2f-42b3ae284d86 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:39.304956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-67b4fef4-926d-47bf-bd2f-42b3ae284d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:39.317133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1100/2227] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:39.332313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b69d5f-3ac8-4697-90b3-ccec09661c13 service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:39.335025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-52b69d5f-3ac8-4697-90b3-ccec09661c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:39.368778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b69d5f-3ac8-4697-90b3-ccec09661c13 service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:39.371777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40484a5d-ba4d-457b-aacf-425f409294a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:39.372602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40484a5d-ba4d-457b-aacf-425f409294a4 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:39.373136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40484a5d-ba4d-457b-aacf-425f409294a4 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:39.373800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40484a5d-ba4d-457b-aacf-425f409294a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:39.385331 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40484a5d-ba4d-457b-aacf-425f409294a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:39.387691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40484a5d-ba4d-457b-aacf-425f409294a4 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:39.419487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1128/2228] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:43.260433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072dfd3-9f54-4aab-a095-e765f0a6cd29 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:43.261004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072dfd3-9f54-4aab-a095-e765f0a6cd29 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:43.261004 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072dfd3-9f54-4aab-a095-e765f0a6cd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:43.297852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3072dfd3-9f54-4aab-a095-e765f0a6cd29 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:43.299990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3072dfd3-9f54-4aab-a095-e765f0a6cd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:43.311266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1101/2229] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:43.334347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40484a5d-ba4d-457b-aacf-425f409294a4 service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:43.354448 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40484a5d-ba4d-457b-aacf-425f409294a4 service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:43.364838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7abd2-5688-4ea2-9c9c-8cd6ece5564b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:43.365927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7abd2-5688-4ea2-9c9c-8cd6ece5564b service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:43.366323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7abd2-5688-4ea2-9c9c-8cd6ece5564b service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:43.366598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7abd2-5688-4ea2-9c9c-8cd6ece5564b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:43.384175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7abd2-5688-4ea2-9c9c-8cd6ece5564b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:43.386342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7abd2-5688-4ea2-9c9c-8cd6ece5564b service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:43.401293 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1129/2230] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:45.967631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072dfd3-9f54-4aab-a095-e765f0a6cd29 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:45.980277 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072dfd3-9f54-4aab-a095-e765f0a6cd29 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:45.988492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:45.989621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:45.990133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:45.990703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] PATH_INFO: `/v3/users/6c52e3b06dcb47e1a950a2929772a19a` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:45.992798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c52e3b06dcb47e1a950a2929772a19a)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:45.996367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:46.213364 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c52e3b06dcb47e1a950a2929772a19a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:46.230525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c52e3b06dcb47e1a950a2929772a19a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:46.236546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:46.301150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c52e3b06dcb47e1a950a2929772a19a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:46.301914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c52e3b06dcb47e1a950a2929772a19a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:46.312759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c52e3b06dcb47e1a950a2929772a19a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:46.321229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1102/2231] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:01:45 2022] DELETE /identity/v3/users/6c52e3b06dcb47e1a950a2929772a19a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:01:46.327425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504436f-a694-4a52-af38-cbf5aae648c6 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:46.328847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504436f-a694-4a52-af38-cbf5aae648c6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:46.329121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504436f-a694-4a52-af38-cbf5aae648c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:46.357285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d504436f-a694-4a52-af38-cbf5aae648c6 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:46.358614 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d504436f-a694-4a52-af38-cbf5aae648c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:46.438053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1130/2232] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:46.449602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:46.451853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:46.545591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6305355-e390-4142-9569-16ab5f96ea6c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:46.552371 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccd90d-1869-4b92-b7ab-04c0268541f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:46.553576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd90d-1869-4b92-b7ab-04c0268541f9 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:46.554167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd90d-1869-4b92-b7ab-04c0268541f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:46.554991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccd90d-1869-4b92-b7ab-04c0268541f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:46.579580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccd90d-1869-4b92-b7ab-04c0268541f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:46.581796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccd90d-1869-4b92-b7ab-04c0268541f9 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:46.595332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1103/2233] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:47.141777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504436f-a694-4a52-af38-cbf5aae648c6 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:47.144167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d504436f-a694-4a52-af38-cbf5aae648c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:47.167358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504436f-a694-4a52-af38-cbf5aae648c6 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:47.174368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:47.175229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:47.175784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:47.176487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] PATH_INFO: `/v3/projects/2b202820bd9d4a10925a7ec8bec5793a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:47.178782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b202820bd9d4a10925a7ec8bec5793a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:47.181824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:47.216176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:47.343573 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b202820bd9d4a10925a7ec8bec5793a', 'request_id': 'req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:47.355737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b202820bd9d4a10925a7ec8bec5793a', 'request_id': 'req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:47.371302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b202820bd9d4a10925a7ec8bec5793a', 'request_id': 'req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:47.501089 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] The token cache is being invalidate because project 2b202820bd9d4a10925a7ec8bec5793a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:01:47.501603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:47.502547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6ea371f-a18c-4ab6-9a4e-c494facaf7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:01:47.504781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1131/2234] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:01:47 2022] DELETE /identity/v3/projects/2b202820bd9d4a10925a7ec8bec5793a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:01:47.512533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ab16d-f7e2-4617-b581-ae0ab11ce315 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:47.513326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ab16d-f7e2-4617-b581-ae0ab11ce315 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:47.513614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ab16d-f7e2-4617-b581-ae0ab11ce315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:47.544810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-090ab16d-f7e2-4617-b581-ae0ab11ce315 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:47.547813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-090ab16d-f7e2-4617-b581-ae0ab11ce315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:47.648573 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1104/2235] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:01:47.736014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6b9c5-3c8e-4173-865e-a97f0fcbaa7a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:47.736421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6b9c5-3c8e-4173-865e-a97f0fcbaa7a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:47.737383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6b9c5-3c8e-4173-865e-a97f0fcbaa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:47.765497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4fa6b9c5-3c8e-4173-865e-a97f0fcbaa7a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:47.767299 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4fa6b9c5-3c8e-4173-865e-a97f0fcbaa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:47.777054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1132/2236] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:47.782961 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ab16d-f7e2-4617-b581-ae0ab11ce315 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:47.798519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ab16d-f7e2-4617-b581-ae0ab11ce315 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:47.805850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd40ecd-03cb-456d-babf-219298cb2d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:47.806629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd40ecd-03cb-456d-babf-219298cb2d1d admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:47.807006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd40ecd-03cb-456d-babf-219298cb2d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:47.807639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd40ecd-03cb-456d-babf-219298cb2d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:47.808426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd40ecd-03cb-456d-babf-219298cb2d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:01:47.808881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd40ecd-03cb-456d-babf-219298cb2d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:47.810910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd40ecd-03cb-456d-babf-219298cb2d1d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:47.827149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1105/2237] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:01:47.838825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6b9c5-3c8e-4173-865e-a97f0fcbaa7a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:47.852279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6b9c5-3c8e-4173-865e-a97f0fcbaa7a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:47.860172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52be86-f970-4137-b4a4-e751bc434192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:47.860904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52be86-f970-4137-b4a4-e751bc434192 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:47.861355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52be86-f970-4137-b4a4-e751bc434192 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:47.861777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52be86-f970-4137-b4a4-e751bc434192 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:47.863246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52be86-f970-4137-b4a4-e751bc434192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:47.866357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52be86-f970-4137-b4a4-e751bc434192 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:47.995562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1133/2238] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:01:47 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:01:48.002607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd40ecd-03cb-456d-babf-219298cb2d1d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:48.021565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd40ecd-03cb-456d-babf-219298cb2d1d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:48.134055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc63ad-3ac6-413c-9d71-2a05ff25272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:48.135005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc63ad-3ac6-413c-9d71-2a05ff25272d admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:48.135360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc63ad-3ac6-413c-9d71-2a05ff25272d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:48.135694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc63ad-3ac6-413c-9d71-2a05ff25272d admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:48.136525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc63ad-3ac6-413c-9d71-2a05ff25272d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:48.138684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc63ad-3ac6-413c-9d71-2a05ff25272d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:48.246810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1106/2239] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:01:48 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:01:48.253711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52be86-f970-4137-b4a4-e751bc434192 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:48.275248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52be86-f970-4137-b4a4-e751bc434192 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:48.288243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9342-8769-4274-afee-dc3c627b93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:48.289521 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9342-8769-4274-afee-dc3c627b93cc admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:48.289993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9342-8769-4274-afee-dc3c627b93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:48.291194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9342-8769-4274-afee-dc3c627b93cc admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:48.292018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9342-8769-4274-afee-dc3c627b93cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:48.293791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9342-8769-4274-afee-dc3c627b93cc admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:48.308577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1134/2240] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:01:48.314809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc63ad-3ac6-413c-9d71-2a05ff25272d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:48.340551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc63ad-3ac6-413c-9d71-2a05ff25272d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:48.354043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9afc6-0f8c-440f-8a3d-cf342992f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:48.355045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9afc6-0f8c-440f-8a3d-cf342992f2cb admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:48.355545 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9afc6-0f8c-440f-8a3d-cf342992f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:48.356318 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9afc6-0f8c-440f-8a3d-cf342992f2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:48.357792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9afc6-0f8c-440f-8a3d-cf342992f2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:48.361045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9afc6-0f8c-440f-8a3d-cf342992f2cb admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:48.363527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:48.383744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1107/2241] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:01:48.390827 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9342-8769-4274-afee-dc3c627b93cc admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:48.413052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9342-8769-4274-afee-dc3c627b93cc admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:48.421653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc40635-4dfe-4f8d-ad8f-371ac7d3a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:48.423119 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40635-4dfe-4f8d-ad8f-371ac7d3a6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:48.423630 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40635-4dfe-4f8d-ad8f-371ac7d3a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:48.424465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40635-4dfe-4f8d-ad8f-371ac7d3a6a1 admin admin] PATH_INFO: `/v3/projects/31422c1902e24bebb96960aff0ad4dc3/users/7bcfec02574441788fe108cbe74d8c55/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:48.456383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc40635-4dfe-4f8d-ad8f-371ac7d3a6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31422c1902e24bebb96960aff0ad4dc3, user_id=7bcfec02574441788fe108cbe74d8c55, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:48.463276 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc40635-4dfe-4f8d-ad8f-371ac7d3a6a1 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:48.688181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1135/2242] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:01:48 2022] PUT /identity/v3/projects/31422c1902e24bebb96960aff0ad4dc3/users/7bcfec02574441788fe108cbe74d8c55/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:01:48.695714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4d81-bad1-47b0-8f1f-39b9ab38d3a0 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:48.696590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4d81-bad1-47b0-8f1f-39b9ab38d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:48.696590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c4d81-bad1-47b0-8f1f-39b9ab38d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:48.725964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b42c4d81-bad1-47b0-8f1f-39b9ab38d3a0 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:48.727981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b42c4d81-bad1-47b0-8f1f-39b9ab38d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:48.839238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1108/2243] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:48.855145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc40635-4dfe-4f8d-ad8f-371ac7d3a6a1 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:48.857907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8cc40635-4dfe-4f8d-ad8f-371ac7d3a6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:48.976795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc40635-4dfe-4f8d-ad8f-371ac7d3a6a1 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:48.987820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464c83-c922-4c55-875a-00da83cdaa5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:48.988905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464c83-c922-4c55-875a-00da83cdaa5c service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:48.989405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464c83-c922-4c55-875a-00da83cdaa5c service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:48.989887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464c83-c922-4c55-875a-00da83cdaa5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:49.007595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464c83-c922-4c55-875a-00da83cdaa5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:49.010970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464c83-c922-4c55-875a-00da83cdaa5c service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:49.030156 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1136/2244] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:49.846823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849d2f-7e9a-4bbd-a632-e6cb6115e736 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:49.847722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849d2f-7e9a-4bbd-a632-e6cb6115e736 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:49.847866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849d2f-7e9a-4bbd-a632-e6cb6115e736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:49.897865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b7849d2f-7e9a-4bbd-a632-e6cb6115e736 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:49.899331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b7849d2f-7e9a-4bbd-a632-e6cb6115e736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:49.914367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1109/2245] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:01:49.957026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464c83-c922-4c55-875a-00da83cdaa5c service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:49.969201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-37464c83-c922-4c55-875a-00da83cdaa5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:50.069813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:50.131356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464c83-c922-4c55-875a-00da83cdaa5c service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:50.146096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bea81-c880-4f24-8ce8-b929e185b559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:50.147212 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bea81-c880-4f24-8ce8-b929e185b559 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:50.148153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bea81-c880-4f24-8ce8-b929e185b559 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:50.148153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bea81-c880-4f24-8ce8-b929e185b559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:50.166663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bea81-c880-4f24-8ce8-b929e185b559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:50.170074 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bea81-c880-4f24-8ce8-b929e185b559 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:50.189076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1137/2246] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:54.421312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e3f85-28e2-4d29-8e38-fab7f6c38e8b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:54.422139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e3f85-28e2-4d29-8e38-fab7f6c38e8b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:54.422305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e3f85-28e2-4d29-8e38-fab7f6c38e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:54.470683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e24e3f85-28e2-4d29-8e38-fab7f6c38e8b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:54.474430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e24e3f85-28e2-4d29-8e38-fab7f6c38e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:01:54.492421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1110/2247] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Aug 22 16:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:01:54.530620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bea81-c880-4f24-8ce8-b929e185b559 service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:01:54.566063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bea81-c880-4f24-8ce8-b929e185b559 service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:01:54.602110 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da70ff-ba24-47c7-8bc0-d70edc955965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:01:54.603357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da70ff-ba24-47c7-8bc0-d70edc955965 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:54.604052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da70ff-ba24-47c7-8bc0-d70edc955965 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:54.623173 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da70ff-ba24-47c7-8bc0-d70edc955965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:54.665946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da70ff-ba24-47c7-8bc0-d70edc955965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:01:54.673446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da70ff-ba24-47c7-8bc0-d70edc955965 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:01:54.730440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1138/2248] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:59.803663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a54b8-f7d6-48a8-a391-724fdebf69c8 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:01:59.807833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a54b8-f7d6-48a8-a391-724fdebf69c8 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:01:59.814159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a54b8-f7d6-48a8-a391-724fdebf69c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:01:59.925475 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-448a54b8-f7d6-48a8-a391-724fdebf69c8 None None] MFA Rules not processed for user `7bcfec02574441788fe108cbe74d8c55`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:01:59.927928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-448a54b8-f7d6-48a8-a391-724fdebf69c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:00.228095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1111/2249] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:01:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:00.234053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da70ff-ba24-47c7-8bc0-d70edc955965 service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:00.254460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da70ff-ba24-47c7-8bc0-d70edc955965 service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:00.269327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3578ca-d80f-4263-a838-ac5b29ece7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:00.270815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3578ca-d80f-4263-a838-ac5b29ece7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:00.271373 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3578ca-d80f-4263-a838-ac5b29ece7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:00.271793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3578ca-d80f-4263-a838-ac5b29ece7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:00.272744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3578ca-d80f-4263-a838-ac5b29ece7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:00.276463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3578ca-d80f-4263-a838-ac5b29ece7e4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:00.436243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1139/2250] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:00 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:00.437705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a54b8-f7d6-48a8-a391-724fdebf69c8 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:00.493457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a54b8-f7d6-48a8-a391-724fdebf69c8 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:00.722631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3c5bd-a870-4581-bf9e-e7afbc932511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:00.724915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3c5bd-a870-4581-bf9e-e7afbc932511 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:00.738602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3c5bd-a870-4581-bf9e-e7afbc932511 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:00.740101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3c5bd-a870-4581-bf9e-e7afbc932511 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:00.742293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3c5bd-a870-4581-bf9e-e7afbc932511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:00.746676 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3c5bd-a870-4581-bf9e-e7afbc932511 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:00.902144 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1112/2251] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:00 2022] POST /identity/v3/users => generated 298 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:02:00.912714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3578ca-d80f-4263-a838-ac5b29ece7e4 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:00.942892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3578ca-d80f-4263-a838-ac5b29ece7e4 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:00.952813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab83aa-e64f-4fa5-9b0b-4ccdb7997e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:00.953850 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab83aa-e64f-4fa5-9b0b-4ccdb7997e66 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:00.954653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab83aa-e64f-4fa5-9b0b-4ccdb7997e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:00.955375 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab83aa-e64f-4fa5-9b0b-4ccdb7997e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:00.957853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab83aa-e64f-4fa5-9b0b-4ccdb7997e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:00.961676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab83aa-e64f-4fa5-9b0b-4ccdb7997e66 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:01.009977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1140/2252] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:01.016378 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3c5bd-a870-4581-bf9e-e7afbc932511 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:01.029781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:01.038258 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3c5bd-a870-4581-bf9e-e7afbc932511 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:01.047342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8ff90-af65-4965-a109-6a71844ac633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:01.048845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8ff90-af65-4965-a109-6a71844ac633 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:01.049402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8ff90-af65-4965-a109-6a71844ac633 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:01.049964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8ff90-af65-4965-a109-6a71844ac633 admin admin] PATH_INFO: `/v3/projects/1c9f631621364962a53e6d5e4271b2a0/users/0f7f3e56b743458f8a1a3e1242700a01/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:01.076960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8ff90-af65-4965-a109-6a71844ac633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9f631621364962a53e6d5e4271b2a0, user_id=0f7f3e56b743458f8a1a3e1242700a01, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:01.082007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8ff90-af65-4965-a109-6a71844ac633 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:01.163937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1113/2253] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:01 2022] PUT /identity/v3/projects/1c9f631621364962a53e6d5e4271b2a0/users/0f7f3e56b743458f8a1a3e1242700a01/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:01.172892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab83aa-e64f-4fa5-9b0b-4ccdb7997e66 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:01.211286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab83aa-e64f-4fa5-9b0b-4ccdb7997e66 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:01.380215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d8ca-84bb-4a0e-bf77-0ba647a942e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:01.381541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d8ca-84bb-4a0e-bf77-0ba647a942e6 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:01.382007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d8ca-84bb-4a0e-bf77-0ba647a942e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:01.382486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d8ca-84bb-4a0e-bf77-0ba647a942e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:01.383641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589d8ca-84bb-4a0e-bf77-0ba647a942e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:01.386808 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589d8ca-84bb-4a0e-bf77-0ba647a942e6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:01.407859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1141/2254] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:01.414485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8ff90-af65-4965-a109-6a71844ac633 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:01.427783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8ff90-af65-4965-a109-6a71844ac633 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:01.434681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d7c5-1545-49bb-b76c-4c76be69cba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:01.435507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d7c5-1545-49bb-b76c-4c76be69cba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:01.435772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d7c5-1545-49bb-b76c-4c76be69cba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:01.436060 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d7c5-1545-49bb-b76c-4c76be69cba9 admin admin] PATH_INFO: `/v3/projects/1c9f631621364962a53e6d5e4271b2a0/users/0f7f3e56b743458f8a1a3e1242700a01/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:01.438884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5d7c5-1545-49bb-b76c-4c76be69cba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9f631621364962a53e6d5e4271b2a0, user_id=0f7f3e56b743458f8a1a3e1242700a01, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:01.443719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5d7c5-1545-49bb-b76c-4c76be69cba9 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:01.464563 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1114/2255] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:01 2022] PUT /identity/v3/projects/1c9f631621364962a53e6d5e4271b2a0/users/0f7f3e56b743458f8a1a3e1242700a01/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:09.023364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50155a0-137f-4ded-bcfe-82eaef9a114d None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:09.023902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50155a0-137f-4ded-bcfe-82eaef9a114d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:09.024313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50155a0-137f-4ded-bcfe-82eaef9a114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:09.103604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d50155a0-137f-4ded-bcfe-82eaef9a114d None None] MFA Rules not processed for user `0f7f3e56b743458f8a1a3e1242700a01`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:09.104987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d50155a0-137f-4ded-bcfe-82eaef9a114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:09.209417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1142/2256] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:02:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:09.224568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d7c5-1545-49bb-b76c-4c76be69cba9 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:09.227674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4ae5d7c5-1545-49bb-b76c-4c76be69cba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:09.327178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d7c5-1545-49bb-b76c-4c76be69cba9 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:09.332163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165332d-a8c9-4b40-85bf-1638b3f164f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2de83ba29194578a9a229d5bab6612e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:09.333424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165332d-a8c9-4b40-85bf-1638b3f164f2 service glance] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:09.333879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165332d-a8c9-4b40-85bf-1638b3f164f2 service glance] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:09.334627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165332d-a8c9-4b40-85bf-1638b3f164f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:09.447916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165332d-a8c9-4b40-85bf-1638b3f164f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:09.450732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165332d-a8c9-4b40-85bf-1638b3f164f2 service glance] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:09.469369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1115/2257] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:09.791989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5537687-2429-4883-aedd-11620c8997f1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:09.792411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5537687-2429-4883-aedd-11620c8997f1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:09.792886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5537687-2429-4883-aedd-11620c8997f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:09.802538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:09.817169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b5537687-2429-4883-aedd-11620c8997f1 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:09.817169 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b5537687-2429-4883-aedd-11620c8997f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:09.896287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1143/2258] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 16:02:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:10.058251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165332d-a8c9-4b40-85bf-1638b3f164f2 service glance] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:10.061056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b165332d-a8c9-4b40-85bf-1638b3f164f2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:10.165895 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165332d-a8c9-4b40-85bf-1638b3f164f2 service glance] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:10.172480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef267c9d-e918-4330-bc37-0e60a7621f2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:10.173289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef267c9d-e918-4330-bc37-0e60a7621f2d service swift] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:10.174183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef267c9d-e918-4330-bc37-0e60a7621f2d service swift] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:10.174699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef267c9d-e918-4330-bc37-0e60a7621f2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:10.186678 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef267c9d-e918-4330-bc37-0e60a7621f2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:10.189871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef267c9d-e918-4330-bc37-0e60a7621f2d service swift] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:10.202876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1116/2259] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:02:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:02:15.382818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0fc4-2883-4b73-a0c5-acc93cb94bb4 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:15.383664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0fc4-2883-4b73-a0c5-acc93cb94bb4 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:15.383880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0fc4-2883-4b73-a0c5-acc93cb94bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:15.488725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-427b0fc4-2883-4b73-a0c5-acc93cb94bb4 None None] MFA Rules not processed for user `d630b75517634f6e9cf0613661fb7695`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:15.497154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-427b0fc4-2883-4b73-a0c5-acc93cb94bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:15.695537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1144/2260] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:02:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:20.199503 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=94,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:20.886409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e2cca-855f-49ea-96ed-8e0246e76448 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:20.886889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e2cca-855f-49ea-96ed-8e0246e76448 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:20.887346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e2cca-855f-49ea-96ed-8e0246e76448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:20.949299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-237e2cca-855f-49ea-96ed-8e0246e76448 None None] MFA Rules not processed for user `1e513898018544c7924d592c40f7dd54`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:20.951789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-237e2cca-855f-49ea-96ed-8e0246e76448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:21.059262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1117/2261] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:24.694291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0fc4-2883-4b73-a0c5-acc93cb94bb4 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:24.698077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-427b0fc4-2883-4b73-a0c5-acc93cb94bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:24.816996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0fc4-2883-4b73-a0c5-acc93cb94bb4 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:24.817495 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362fcdd-ab02-46a8-8405-e60f2dc25c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:24.818269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fcdd-ab02-46a8-8405-e60f2dc25c0f service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:24.818553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fcdd-ab02-46a8-8405-e60f2dc25c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:24.818852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fcdd-ab02-46a8-8405-e60f2dc25c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:24.825197 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f362fcdd-ab02-46a8-8405-e60f2dc25c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:25.077236 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:25.092828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362fcdd-ab02-46a8-8405-e60f2dc25c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:25.107260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362fcdd-ab02-46a8-8405-e60f2dc25c0f service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:25.142961 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1145/2262] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:02:26.603478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e2cca-855f-49ea-96ed-8e0246e76448 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:26.627399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e2cca-855f-49ea-96ed-8e0246e76448 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:26.635185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47489e0-85d2-40d5-a4b8-ad920cd41aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:26.636977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47489e0-85d2-40d5-a4b8-ad920cd41aaf service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:26.637784 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47489e0-85d2-40d5-a4b8-ad920cd41aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:26.638296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47489e0-85d2-40d5-a4b8-ad920cd41aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:26.641950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a47489e0-85d2-40d5-a4b8-ad920cd41aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:26.696420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47489e0-85d2-40d5-a4b8-ad920cd41aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:26.699538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47489e0-85d2-40d5-a4b8-ad920cd41aaf service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:26.736936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1118/2263] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:02:28.571049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647c6a-7570-4c55-b2f0-c0d5b8191724 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:28.571842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647c6a-7570-4c55-b2f0-c0d5b8191724 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:28.571842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a647c6a-7570-4c55-b2f0-c0d5b8191724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:28.592382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4a647c6a-7570-4c55-b2f0-c0d5b8191724 None None] MFA Rules not processed for user `7bcfec02574441788fe108cbe74d8c55`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:28.593607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4a647c6a-7570-4c55-b2f0-c0d5b8191724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:28.601584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1146/2264] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:02:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:31.608476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47489e0-85d2-40d5-a4b8-ad920cd41aaf service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.624256 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47489e0-85d2-40d5-a4b8-ad920cd41aaf service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.634225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b550e1-6939-4072-8c4f-5ae91830d577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.635311 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b550e1-6939-4072-8c4f-5ae91830d577 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.635805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b550e1-6939-4072-8c4f-5ae91830d577 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.636299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b550e1-6939-4072-8c4f-5ae91830d577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.640611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-95b550e1-6939-4072-8c4f-5ae91830d577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:31.660278 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b550e1-6939-4072-8c4f-5ae91830d577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.662268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b550e1-6939-4072-8c4f-5ae91830d577 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.678696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1119/2265] 10.222.0.18 () {60 vars in 1396 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:02:32.455116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a647c6a-7570-4c55-b2f0-c0d5b8191724 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:32.456561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4a647c6a-7570-4c55-b2f0-c0d5b8191724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:32.524469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a647c6a-7570-4c55-b2f0-c0d5b8191724 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:32.528842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1408-b670-429a-b3ae-ff131dfc1e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:32.534311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1408-b670-429a-b3ae-ff131dfc1e45 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.534311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1408-b670-429a-b3ae-ff131dfc1e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.534311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1408-b670-429a-b3ae-ff131dfc1e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.534311 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-71db1408-b670-429a-b3ae-ff131dfc1e45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:32.605009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db1408-b670-429a-b3ae-ff131dfc1e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:32.606468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db1408-b670-429a-b3ae-ff131dfc1e45 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:32.620368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1147/2266] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:32.994423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a77d7-9d71-4e77-bfe5-399df6a1af2d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.995087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a77d7-9d71-4e77-bfe5-399df6a1af2d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.995087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a77d7-9d71-4e77-bfe5-399df6a1af2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.019271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-bf7a77d7-9d71-4e77-bfe5-399df6a1af2d None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:33.020999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bf7a77d7-9d71-4e77-bfe5-399df6a1af2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:33.030918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1120/2267] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 16:02:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:33.048942 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1408-b670-429a-b3ae-ff131dfc1e45 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.074847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1408-b670-429a-b3ae-ff131dfc1e45 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:33.081496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de24ae-fea8-414b-b127-f612b4196c11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:33.082139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de24ae-fea8-414b-b127-f612b4196c11 service swift] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.082424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de24ae-fea8-414b-b127-f612b4196c11 service swift] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.082694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de24ae-fea8-414b-b127-f612b4196c11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.094390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de24ae-fea8-414b-b127-f612b4196c11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:33.096658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de24ae-fea8-414b-b127-f612b4196c11 service swift] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:33.108642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1148/2268] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:02:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:02:34.683687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a77d7-9d71-4e77-bfe5-399df6a1af2d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:34.689314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bf7a77d7-9d71-4e77-bfe5-399df6a1af2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:34.707824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a77d7-9d71-4e77-bfe5-399df6a1af2d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:34.715498 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ad451-2d2f-4a65-a393-c0d4a6d63aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:34.732933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ad451-2d2f-4a65-a393-c0d4a6d63aca service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:34.732933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ad451-2d2f-4a65-a393-c0d4a6d63aca service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:34.732933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ad451-2d2f-4a65-a393-c0d4a6d63aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:34.732933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-686ad451-2d2f-4a65-a393-c0d4a6d63aca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:34.817744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ad451-2d2f-4a65-a393-c0d4a6d63aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:34.821336 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ad451-2d2f-4a65-a393-c0d4a6d63aca service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:34.847019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1121/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:40.136806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496281b4-54db-4262-a32d-2b4ac7aed5a9 None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:40.137475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496281b4-54db-4262-a32d-2b4ac7aed5a9 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:40.137475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496281b4-54db-4262-a32d-2b4ac7aed5a9 None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:40.140235 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1149/2270] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 16:02:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:02:40.154760 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eecc5-e93e-4fb9-af70-acfbe1c3c597 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:40.156730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eecc5-e93e-4fb9-af70-acfbe1c3c597 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:40.158387 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eecc5-e93e-4fb9-af70-acfbe1c3c597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:40.197677 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7d9eecc5-e93e-4fb9-af70-acfbe1c3c597 None None] MFA Rules not processed for user `9ecb4e7e9e3042adadd93229f8456eca`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:40.199967 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7d9eecc5-e93e-4fb9-af70-acfbe1c3c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:40.297108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1122/2271] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 16:02:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:40.310835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496281b4-54db-4262-a32d-2b4ac7aed5a9 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:40.313483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-496281b4-54db-4262-a32d-2b4ac7aed5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:40.328060 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eecc5-e93e-4fb9-af70-acfbe1c3c597 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:40.330372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7d9eecc5-e93e-4fb9-af70-acfbe1c3c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:40.357728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:40.369639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496281b4-54db-4262-a32d-2b4ac7aed5a9 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:40.383734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f516d-9f1b-4058-9585-41fa0064ea42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecb4e7e9e3042adadd93229f8456eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:40.383734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f516d-9f1b-4058-9585-41fa0064ea42 service placement] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:40.383734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f516d-9f1b-4058-9585-41fa0064ea42 service placement] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:40.383734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f516d-9f1b-4058-9585-41fa0064ea42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:40.397091 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f516d-9f1b-4058-9585-41fa0064ea42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:40.399920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f516d-9f1b-4058-9585-41fa0064ea42 service placement] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:40.418241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1150/2272] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:40.500052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eecc5-e93e-4fb9-af70-acfbe1c3c597 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:40.506721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:40.507767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:40.508264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:40.508807 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] PATH_INFO: `/v3/users/e031381744f54bd38e0ea250f0e3abd1` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:40.510176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e031381744f54bd38e0ea250f0e3abd1)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:40.512715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:40.818758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e031381744f54bd38e0ea250f0e3abd1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.834853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e031381744f54bd38e0ea250f0e3abd1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.233469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e031381744f54bd38e0ea250f0e3abd1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.236236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e031381744f54bd38e0ea250f0e3abd1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.250928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1c14d141-b1fc-419f-aa4a-22024870063b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e031381744f54bd38e0ea250f0e3abd1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.260552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1123/2273] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:02:40 2022] DELETE /identity/v3/users/e031381744f54bd38e0ea250f0e3abd1 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:41.900800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f516d-9f1b-4058-9585-41fa0064ea42 service placement] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:41.935955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f516d-9f1b-4058-9585-41fa0064ea42 service placement] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:42.042005 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:42.045917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.045917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.045917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] PATH_INFO: `/v3/projects/8acf3838c7de4add99d51667b40f5d03` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.048618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8acf3838c7de4add99d51667b40f5d03)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:42.052881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:42.098685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:42.278179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8acf3838c7de4add99d51667b40f5d03', 'request_id': 'req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.289381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8acf3838c7de4add99d51667b40f5d03', 'request_id': 'req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.301321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8acf3838c7de4add99d51667b40f5d03', 'request_id': 'req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.389460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] The token cache is being invalidate because project 8acf3838c7de4add99d51667b40f5d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:02:42.389680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.390507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa49d0a6-46fc-4ae5-b7f3-a73b8cf56c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.392352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1151/2274] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:02:41 2022] DELETE /identity/v3/projects/8acf3838c7de4add99d51667b40f5d03 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:42.397755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e6ce-7222-4177-9690-60e8eab1a12c None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.398333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e6ce-7222-4177-9690-60e8eab1a12c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.398527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e6ce-7222-4177-9690-60e8eab1a12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.430468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-0e71e6ce-7222-4177-9690-60e8eab1a12c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:42.432814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0e71e6ce-7222-4177-9690-60e8eab1a12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:42.607398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1124/2275] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:42.616255 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3743d-99da-4c14-a43f-7315451123e3 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.616638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3743d-99da-4c14-a43f-7315451123e3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.616976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3743d-99da-4c14-a43f-7315451123e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.654949 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-7ea3743d-99da-4c14-a43f-7315451123e3 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:42.659850 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7ea3743d-99da-4c14-a43f-7315451123e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:42.678975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1152/2276] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:42.686323 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e6ce-7222-4177-9690-60e8eab1a12c None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:42.705175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e6ce-7222-4177-9690-60e8eab1a12c None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:42.713518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bdfc5-b161-46f2-a0d6-dee6385c211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:42.714481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bdfc5-b161-46f2-a0d6-dee6385c211a admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.714984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bdfc5-b161-46f2-a0d6-dee6385c211a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.715444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bdfc5-b161-46f2-a0d6-dee6385c211a admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.717228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bdfc5-b161-46f2-a0d6-dee6385c211a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:42.717363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bdfc5-b161-46f2-a0d6-dee6385c211a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:42.721016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bdfc5-b161-46f2-a0d6-dee6385c211a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:42.756899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1125/2277] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:42.757710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3743d-99da-4c14-a43f-7315451123e3 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:42.786886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3743d-99da-4c14-a43f-7315451123e3 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:42.786886 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a56371-5540-4052-9e76-c9d08da25f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:42.794368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a56371-5540-4052-9e76-c9d08da25f97 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.794646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a56371-5540-4052-9e76-c9d08da25f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.794914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a56371-5540-4052-9e76-c9d08da25f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.795587 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a56371-5540-4052-9e76-c9d08da25f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:42.797669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a56371-5540-4052-9e76-c9d08da25f97 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:43.018484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1153/2278] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:42 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:02:43.022797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bdfc5-b161-46f2-a0d6-dee6385c211a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:43.046108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bdfc5-b161-46f2-a0d6-dee6385c211a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:43.062053 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:43.127853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169f506-0f07-466f-bee9-5511bb2068f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:43.128986 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f506-0f07-466f-bee9-5511bb2068f6 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.129470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f506-0f07-466f-bee9-5511bb2068f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.129952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f506-0f07-466f-bee9-5511bb2068f6 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.131145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169f506-0f07-466f-bee9-5511bb2068f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:43.135150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169f506-0f07-466f-bee9-5511bb2068f6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:43.258117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1126/2279] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:43 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:43.268277 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a56371-5540-4052-9e76-c9d08da25f97 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:43.280744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a56371-5540-4052-9e76-c9d08da25f97 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:43.286558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72485d-c364-453f-94e5-fbcd553624ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:43.287181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72485d-c364-453f-94e5-fbcd553624ab admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.287485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72485d-c364-453f-94e5-fbcd553624ab admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.287765 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72485d-c364-453f-94e5-fbcd553624ab admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.288499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72485d-c364-453f-94e5-fbcd553624ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:43.290247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72485d-c364-453f-94e5-fbcd553624ab admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:43.308126 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1154/2280] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:43.310652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169f506-0f07-466f-bee9-5511bb2068f6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:43.327154 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169f506-0f07-466f-bee9-5511bb2068f6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:43.334752 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ce74e-5fcc-412a-a117-a18090585e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:43.336138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ce74e-5fcc-412a-a117-a18090585e2c admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.336474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ce74e-5fcc-412a-a117-a18090585e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.336973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ce74e-5fcc-412a-a117-a18090585e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.338169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ce74e-5fcc-412a-a117-a18090585e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:43.340950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ce74e-5fcc-412a-a117-a18090585e2c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:43.358615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1127/2281] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:02:43.363498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72485d-c364-453f-94e5-fbcd553624ab admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:43.376888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72485d-c364-453f-94e5-fbcd553624ab admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:43.382096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4437b8-30b1-466c-bad9-22e0ad83ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:43.382936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4437b8-30b1-466c-bad9-22e0ad83ba13 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.383246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4437b8-30b1-466c-bad9-22e0ad83ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.383524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4437b8-30b1-466c-bad9-22e0ad83ba13 admin admin] PATH_INFO: `/v3/projects/c0d518cc1cfb4d89a8ccdda6ee92c6bb/users/d431e38e573d4c79a1343cea1153d05f/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.412065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4437b8-30b1-466c-bad9-22e0ad83ba13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d518cc1cfb4d89a8ccdda6ee92c6bb, user_id=d431e38e573d4c79a1343cea1153d05f, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:43.417162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4437b8-30b1-466c-bad9-22e0ad83ba13 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:43.482024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1155/2282] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:43 2022] PUT /identity/v3/projects/c0d518cc1cfb4d89a8ccdda6ee92c6bb/users/d431e38e573d4c79a1343cea1153d05f/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:43.489964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c5fd1-b0a2-485d-8f7e-b592e5653246 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.489964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c5fd1-b0a2-485d-8f7e-b592e5653246 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.489964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c5fd1-b0a2-485d-8f7e-b592e5653246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.513374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-af0c5fd1-b0a2-485d-8f7e-b592e5653246 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:43.514609 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-af0c5fd1-b0a2-485d-8f7e-b592e5653246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:43.599638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1128/2283] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:43.610463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4437b8-30b1-466c-bad9-22e0ad83ba13 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:43.612218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-be4437b8-30b1-466c-bad9-22e0ad83ba13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:43.681205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4437b8-30b1-466c-bad9-22e0ad83ba13 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:43.693333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455e491-14e8-40bc-a90e-3b555cecad46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:43.694506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455e491-14e8-40bc-a90e-3b555cecad46 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.694506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455e491-14e8-40bc-a90e-3b555cecad46 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.695694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455e491-14e8-40bc-a90e-3b555cecad46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.726992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455e491-14e8-40bc-a90e-3b555cecad46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:43.730479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455e491-14e8-40bc-a90e-3b555cecad46 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:43.748286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1156/2284] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:48.642334 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c5fd1-b0a2-485d-8f7e-b592e5653246 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:48.659909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c5fd1-b0a2-485d-8f7e-b592e5653246 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:48.666050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9eda7-c06b-452b-8b0c-3edcd11799d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:48.667171 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9eda7-c06b-452b-8b0c-3edcd11799d7 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:48.667716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9eda7-c06b-452b-8b0c-3edcd11799d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:48.668260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9eda7-c06b-452b-8b0c-3edcd11799d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:48.670689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-60e9eda7-c06b-452b-8b0c-3edcd11799d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:48.712937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9eda7-c06b-452b-8b0c-3edcd11799d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:48.714937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9eda7-c06b-452b-8b0c-3edcd11799d7 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:48.741500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1129/2285] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:49.414140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28231566-2d7a-445c-a745-7c95a72e7d91 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.417640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28231566-2d7a-445c-a745-7c95a72e7d91 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.419368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28231566-2d7a-445c-a745-7c95a72e7d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.458078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-28231566-2d7a-445c-a745-7c95a72e7d91 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:49.459569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-28231566-2d7a-445c-a745-7c95a72e7d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:49.535729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:49.581874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1157/2286] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 16:02:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:49.600832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9eda7-c06b-452b-8b0c-3edcd11799d7 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:49.602582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-60e9eda7-c06b-452b-8b0c-3edcd11799d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:49.788877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9eda7-c06b-452b-8b0c-3edcd11799d7 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:49.805913 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13e38d-46cc-4da8-8258-85445873bee2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:49.806903 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13e38d-46cc-4da8-8258-85445873bee2 service swift] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.807442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13e38d-46cc-4da8-8258-85445873bee2 service swift] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.807885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13e38d-46cc-4da8-8258-85445873bee2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.824158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13e38d-46cc-4da8-8258-85445873bee2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:49.826989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13e38d-46cc-4da8-8258-85445873bee2 service swift] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:49.839554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1130/2287] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:02:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:02:53.940979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da09c-dd81-4c10-8417-095f850a9d51 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:53.941688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da09c-dd81-4c10-8417-095f850a9d51 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:53.941688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da09c-dd81-4c10-8417-095f850a9d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.038345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-790da09c-dd81-4c10-8417-095f850a9d51 None None] MFA Rules not processed for user `d431e38e573d4c79a1343cea1153d05f`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:54.048267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-790da09c-dd81-4c10-8417-095f850a9d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:54.225599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1158/2288] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:02:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:54.230397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13e38d-46cc-4da8-8258-85445873bee2 service swift] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:54.265602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13e38d-46cc-4da8-8258-85445873bee2 service swift] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:54.301969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add4b82-86a2-45a5-8d8f-2e992ccf2bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:54.303391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4b82-86a2-45a5-8d8f-2e992ccf2bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:54.303900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4b82-86a2-45a5-8d8f-2e992ccf2bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:54.304463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4b82-86a2-45a5-8d8f-2e992ccf2bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.305600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add4b82-86a2-45a5-8d8f-2e992ccf2bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:54.307882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add4b82-86a2-45a5-8d8f-2e992ccf2bc8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:54.321621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:54.456037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1131/2289] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:54 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:54.468832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790da09c-dd81-4c10-8417-095f850a9d51 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:54.505657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790da09c-dd81-4c10-8417-095f850a9d51 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:54.630041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0f56a-a69b-41a9-bbac-0dfe2ddfe3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:54.630681 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f56a-a69b-41a9-bbac-0dfe2ddfe3fb admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:54.630959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f56a-a69b-41a9-bbac-0dfe2ddfe3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:54.631224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0f56a-a69b-41a9-bbac-0dfe2ddfe3fb admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.631912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0f56a-a69b-41a9-bbac-0dfe2ddfe3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:54.638217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0f56a-a69b-41a9-bbac-0dfe2ddfe3fb admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:54.807061 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1159/2290] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:54 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:54.818260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add4b82-86a2-45a5-8d8f-2e992ccf2bc8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:54.855830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add4b82-86a2-45a5-8d8f-2e992ccf2bc8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:54.866274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09e420-5e51-473b-9420-466b41b14abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:54.867336 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09e420-5e51-473b-9420-466b41b14abf admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:54.867814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09e420-5e51-473b-9420-466b41b14abf admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:54.870533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09e420-5e51-473b-9420-466b41b14abf admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.870533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09e420-5e51-473b-9420-466b41b14abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:54.876367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09e420-5e51-473b-9420-466b41b14abf admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:54.892157 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1132/2291] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:54.895814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0f56a-a69b-41a9-bbac-0dfe2ddfe3fb admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:54.907778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0f56a-a69b-41a9-bbac-0dfe2ddfe3fb admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:54.913127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51648d20-5ece-4869-8829-cde0a6fb4487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:54.913928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51648d20-5ece-4869-8829-cde0a6fb4487 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:54.914205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51648d20-5ece-4869-8829-cde0a6fb4487 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:54.914477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51648d20-5ece-4869-8829-cde0a6fb4487 admin admin] PATH_INFO: `/v3/projects/4b3167a80a3c461480ce2702f0153997/users/2baec4f8f6a24d6caecda9195d271074/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.936180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51648d20-5ece-4869-8829-cde0a6fb4487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3167a80a3c461480ce2702f0153997, user_id=2baec4f8f6a24d6caecda9195d271074, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:54.938936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51648d20-5ece-4869-8829-cde0a6fb4487 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:55.404884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1160/2292] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:54 2022] PUT /identity/v3/projects/4b3167a80a3c461480ce2702f0153997/users/2baec4f8f6a24d6caecda9195d271074/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:02:55.409470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09e420-5e51-473b-9420-466b41b14abf admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:55.420902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09e420-5e51-473b-9420-466b41b14abf admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:55.568013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bbd7a-f69c-45e3-88c1-0ceb1c7bf6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:55.568707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bbd7a-f69c-45e3-88c1-0ceb1c7bf6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.568993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bbd7a-f69c-45e3-88c1-0ceb1c7bf6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.569270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bbd7a-f69c-45e3-88c1-0ceb1c7bf6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.570306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bbd7a-f69c-45e3-88c1-0ceb1c7bf6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:55.572038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bbd7a-f69c-45e3-88c1-0ceb1c7bf6a1 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:55.584223 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1133/2293] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:02:55.590786 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51648d20-5ece-4869-8829-cde0a6fb4487 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:55.627161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51648d20-5ece-4869-8829-cde0a6fb4487 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:55.668305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3b832-f9ee-4b2e-ac7c-cf817aff9318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:55.668305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b832-f9ee-4b2e-ac7c-cf817aff9318 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.668305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b832-f9ee-4b2e-ac7c-cf817aff9318 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.668305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b832-f9ee-4b2e-ac7c-cf817aff9318 admin admin] PATH_INFO: `/v3/projects/4b3167a80a3c461480ce2702f0153997/users/2baec4f8f6a24d6caecda9195d271074/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.677900 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3b832-f9ee-4b2e-ac7c-cf817aff9318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3167a80a3c461480ce2702f0153997, user_id=2baec4f8f6a24d6caecda9195d271074, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:55.682827 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3b832-f9ee-4b2e-ac7c-cf817aff9318 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:55.714853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1161/2294] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:55 2022] PUT /identity/v3/projects/4b3167a80a3c461480ce2702f0153997/users/2baec4f8f6a24d6caecda9195d271074/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:05.581009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:05.725117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=80,keystone:INSERT=5 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:07.464122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bbd7a-f69c-45e3-88c1-0ceb1c7bf6a1 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:07.465614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-db2bbd7a-f69c-45e3-88c1-0ceb1c7bf6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:07.659733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bbd7a-f69c-45e3-88c1-0ceb1c7bf6a1 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:07.943583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f09ee-b1ad-46cf-b815-289b6075d52e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:07.943583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f09ee-b1ad-46cf-b815-289b6075d52e service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:07.943583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f09ee-b1ad-46cf-b815-289b6075d52e service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:07.943583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f09ee-b1ad-46cf-b815-289b6075d52e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:07.956406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f12f09ee-b1ad-46cf-b815-289b6075d52e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:08.000820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f09ee-b1ad-46cf-b815-289b6075d52e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:08.015435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f09ee-b1ad-46cf-b815-289b6075d52e service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:08.044599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1134/2295] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:08.749774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331e0af-c52d-4260-adc4-2135abb79362 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:08.751340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331e0af-c52d-4260-adc4-2135abb79362 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:08.751897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331e0af-c52d-4260-adc4-2135abb79362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:08.834645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3331e0af-c52d-4260-adc4-2135abb79362 None None] MFA Rules not processed for user `2baec4f8f6a24d6caecda9195d271074`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:08.836013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3331e0af-c52d-4260-adc4-2135abb79362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:09.062085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f09ee-b1ad-46cf-b815-289b6075d52e service nova] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:09.072007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1162/2296] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:09.120771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331e0af-c52d-4260-adc4-2135abb79362 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:09.155562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331e0af-c52d-4260-adc4-2135abb79362 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:09.187157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e660-b8f6-4f0a-95c3-b70acf220449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:09.187157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e660-b8f6-4f0a-95c3-b70acf220449 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:09.187157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e660-b8f6-4f0a-95c3-b70acf220449 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:09.187157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e660-b8f6-4f0a-95c3-b70acf220449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:09.204158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f09ee-b1ad-46cf-b815-289b6075d52e service nova] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:09.211076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219d126-c337-41f7-b24c-fcaecd7c3d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:09.212144 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219d126-c337-41f7-b24c-fcaecd7c3d2a service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:09.212919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219d126-c337-41f7-b24c-fcaecd7c3d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:09.213517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219d126-c337-41f7-b24c-fcaecd7c3d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:09.216400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6219d126-c337-41f7-b24c-fcaecd7c3d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:09.299580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:09.365538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219d126-c337-41f7-b24c-fcaecd7c3d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:09.370341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219d126-c337-41f7-b24c-fcaecd7c3d2a service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:09.374420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739e660-b8f6-4f0a-95c3-b70acf220449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:09.377581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739e660-b8f6-4f0a-95c3-b70acf220449 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:09.390914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1163/2297] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:09.411956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1135/2298] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:13.370752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5016f-b227-4b46-8c6b-fa24e811cd0e None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.372267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5016f-b227-4b46-8c6b-fa24e811cd0e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.372796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5016f-b227-4b46-8c6b-fa24e811cd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.398308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4ed5016f-b227-4b46-8c6b-fa24e811cd0e None None] MFA Rules not processed for user `d431e38e573d4c79a1343cea1153d05f`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:13.404855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4ed5016f-b227-4b46-8c6b-fa24e811cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:13.418250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1164/2299] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:13.533179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219d126-c337-41f7-b24c-fcaecd7c3d2a service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:13.534876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6219d126-c337-41f7-b24c-fcaecd7c3d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:13.564792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219d126-c337-41f7-b24c-fcaecd7c3d2a service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:13.574635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277402c-f844-41e7-9aec-77a75e5b70e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:13.575540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277402c-f844-41e7-9aec-77a75e5b70e2 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.576171 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277402c-f844-41e7-9aec-77a75e5b70e2 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.577445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277402c-f844-41e7-9aec-77a75e5b70e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.580261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7277402c-f844-41e7-9aec-77a75e5b70e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:13.600095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277402c-f844-41e7-9aec-77a75e5b70e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:13.603494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277402c-f844-41e7-9aec-77a75e5b70e2 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:13.619830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1136/2300] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:13.632648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5016f-b227-4b46-8c6b-fa24e811cd0e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:13.662784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5016f-b227-4b46-8c6b-fa24e811cd0e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:13.687344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c7650-0f49-4e04-b6c3-4ab02120c324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:13.691301 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c7650-0f49-4e04-b6c3-4ab02120c324 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.693148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c7650-0f49-4e04-b6c3-4ab02120c324 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.694068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c7650-0f49-4e04-b6c3-4ab02120c324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.704486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ec1c7650-0f49-4e04-b6c3-4ab02120c324 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:13.768536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c7650-0f49-4e04-b6c3-4ab02120c324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:13.776321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c7650-0f49-4e04-b6c3-4ab02120c324 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:13.850862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1165/2301] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:19.988788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bbd3f-181d-4fd3-8899-9e96f1f07868 None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.989350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bbd3f-181d-4fd3-8899-9e96f1f07868 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.989915 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bbd3f-181d-4fd3-8899-9e96f1f07868 None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.993179 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1137/2302] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 16:03:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:03:20.000369 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f63f90-196f-4097-8522-bf3afdd5ce38 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.001237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f63f90-196f-4097-8522-bf3afdd5ce38 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.001237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f63f90-196f-4097-8522-bf3afdd5ce38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.046318 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d3f63f90-196f-4097-8522-bf3afdd5ce38 None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:20.048550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d3f63f90-196f-4097-8522-bf3afdd5ce38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:20.061051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1166/2303] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:20.076899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bbd3f-181d-4fd3-8899-9e96f1f07868 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.077562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c99bbd3f-181d-4fd3-8899-9e96f1f07868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:20.176744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bbd3f-181d-4fd3-8899-9e96f1f07868 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.183001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48bb15-00ee-4dcd-a73f-e86f80e8639f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2de83ba29194578a9a229d5bab6612e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.184667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48bb15-00ee-4dcd-a73f-e86f80e8639f service glance] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.185378 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48bb15-00ee-4dcd-a73f-e86f80e8639f service glance] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.185847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48bb15-00ee-4dcd-a73f-e86f80e8639f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.216737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48bb15-00ee-4dcd-a73f-e86f80e8639f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.216737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48bb15-00ee-4dcd-a73f-e86f80e8639f service glance] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.238412 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1138/2304] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:20.517229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f83aa-407e-4f2c-a015-8a193e75afeb None None] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.517661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f83aa-407e-4f2c-a015-8a193e75afeb None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.517959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f83aa-407e-4f2c-a015-8a193e75afeb None None] PATH_INFO: `/` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.519400 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1167/2305] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 16:03:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:03:20.528651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c56e-7a9b-4bbd-900b-c02748f2d881 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.528951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c56e-7a9b-4bbd-900b-c02748f2d881 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.529213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c56e-7a9b-4bbd-900b-c02748f2d881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.553695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8350c56e-7a9b-4bbd-900b-c02748f2d881 None None] MFA Rules not processed for user `90324fa56d0743699f2fddd17fb630dd`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:20.553695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8350c56e-7a9b-4bbd-900b-c02748f2d881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:20.572146 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1139/2306] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 16:03:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:20.592825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f83aa-407e-4f2c-a015-8a193e75afeb None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.610515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f83aa-407e-4f2c-a015-8a193e75afeb None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.616078 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbfc45-6392-434d-bf5a-db9e6f0a366b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.616413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbfc45-6392-434d-bf5a-db9e6f0a366b service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.616790 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbfc45-6392-434d-bf5a-db9e6f0a366b service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.617182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbfc45-6392-434d-bf5a-db9e6f0a366b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.630427 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbfc45-6392-434d-bf5a-db9e6f0a366b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.633051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbfc45-6392-434d-bf5a-db9e6f0a366b service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.647834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1168/2307] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:20.744490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad4d1-9bd8-457d-8400-6efe0bda812d None None] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.744804 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad4d1-9bd8-457d-8400-6efe0bda812d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.745078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ad4d1-9bd8-457d-8400-6efe0bda812d None None] PATH_INFO: `/` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.746614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1140/2308] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 16:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:03:20.753541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6869621-fdfd-4f56-bfa5-80cd2c09e38a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.753821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6869621-fdfd-4f56-bfa5-80cd2c09e38a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.754090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6869621-fdfd-4f56-bfa5-80cd2c09e38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.775891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-a6869621-fdfd-4f56-bfa5-80cd2c09e38a None None] MFA Rules not processed for user `1c12495a6cf64c80b45785f185f28383`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:20.777253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a6869621-fdfd-4f56-bfa5-80cd2c09e38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:20.787572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1169/2309] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 16:03:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:20.798525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad4d1-9bd8-457d-8400-6efe0bda812d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.810835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ad4d1-9bd8-457d-8400-6efe0bda812d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.815673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558ca34-752a-4c39-82ff-f44a684b52ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.816408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558ca34-752a-4c39-82ff-f44a684b52ab service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.816979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558ca34-752a-4c39-82ff-f44a684b52ab service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.817159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558ca34-752a-4c39-82ff-f44a684b52ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.832885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558ca34-752a-4c39-82ff-f44a684b52ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.834581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558ca34-752a-4c39-82ff-f44a684b52ab service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.851590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1141/2310] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:20.926182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6869621-fdfd-4f56-bfa5-80cd2c09e38a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.927655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-a6869621-fdfd-4f56-bfa5-80cd2c09e38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:20.977076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:21.008854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6869621-fdfd-4f56-bfa5-80cd2c09e38a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:21.014945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76563998-5d7d-42fa-9066-bf662fc77fba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecb4e7e9e3042adadd93229f8456eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:21.015584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76563998-5d7d-42fa-9066-bf662fc77fba service placement] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.015878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76563998-5d7d-42fa-9066-bf662fc77fba service placement] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.016151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76563998-5d7d-42fa-9066-bf662fc77fba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.018108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-76563998-5d7d-42fa-9066-bf662fc77fba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:21.031654 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76563998-5d7d-42fa-9066-bf662fc77fba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:21.033346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76563998-5d7d-42fa-9066-bf662fc77fba service placement] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:21.043389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1170/2311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:24.811142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558ca34-752a-4c39-82ff-f44a684b52ab service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:24.813912 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c558ca34-752a-4c39-82ff-f44a684b52ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:24.833227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558ca34-752a-4c39-82ff-f44a684b52ab service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:24.839054 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636323-724f-40e6-8067-b21b5a660a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:24.840067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636323-724f-40e6-8067-b21b5a660a28 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:24.840584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636323-724f-40e6-8067-b21b5a660a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:24.841069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70636323-724f-40e6-8067-b21b5a660a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:24.844078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-70636323-724f-40e6-8067-b21b5a660a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:24.943400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636323-724f-40e6-8067-b21b5a660a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:24.944888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70636323-724f-40e6-8067-b21b5a660a28 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:24.955892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1142/2312] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:27.097747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705f7d-b18b-4822-ab8d-f4e0656a8531 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:27.098229 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705f7d-b18b-4822-ab8d-f4e0656a8531 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:27.098868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705f7d-b18b-4822-ab8d-f4e0656a8531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:27.128075 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-8f705f7d-b18b-4822-ab8d-f4e0656a8531 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:27.129612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8f705f7d-b18b-4822-ab8d-f4e0656a8531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:27.236778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1171/2313] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 16:03:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:27.269202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636323-724f-40e6-8067-b21b5a660a28 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:27.334010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:27.365866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70636323-724f-40e6-8067-b21b5a660a28 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:27.372344 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b81b1c-5713-4444-ae2c-a499a4f5ec65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:27.373582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b81b1c-5713-4444-ae2c-a499a4f5ec65 service swift] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:27.374101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b81b1c-5713-4444-ae2c-a499a4f5ec65 service swift] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:27.375000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b81b1c-5713-4444-ae2c-a499a4f5ec65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:27.386070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b81b1c-5713-4444-ae2c-a499a4f5ec65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:27.387854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b81b1c-5713-4444-ae2c-a499a4f5ec65 service swift] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:27.404012 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1143/2314] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:03:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:03:31.439138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705f7d-b18b-4822-ab8d-f4e0656a8531 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:31.458600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705f7d-b18b-4822-ab8d-f4e0656a8531 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:31.464823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dbf3d-3eeb-48b3-8ae8-fcdcab433454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:31.466029 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dbf3d-3eeb-48b3-8ae8-fcdcab433454 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.466378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dbf3d-3eeb-48b3-8ae8-fcdcab433454 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.466903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dbf3d-3eeb-48b3-8ae8-fcdcab433454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.479807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-740dbf3d-3eeb-48b3-8ae8-fcdcab433454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:31.526908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dbf3d-3eeb-48b3-8ae8-fcdcab433454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:31.534672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dbf3d-3eeb-48b3-8ae8-fcdcab433454 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:31.556562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1172/2315] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:32.271133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b81b1c-5713-4444-ae2c-a499a4f5ec65 service swift] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:32.288940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b81b1c-5713-4444-ae2c-a499a4f5ec65 service swift] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:32.299230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c4bfb-0eac-4a8e-8b41-3b132548f19c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecb4e7e9e3042adadd93229f8456eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:32.300845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c4bfb-0eac-4a8e-8b41-3b132548f19c service placement] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:32.307945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c4bfb-0eac-4a8e-8b41-3b132548f19c service placement] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:32.307945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c4bfb-0eac-4a8e-8b41-3b132548f19c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:32.307945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-604c4bfb-0eac-4a8e-8b41-3b132548f19c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:32.320734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c4bfb-0eac-4a8e-8b41-3b132548f19c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:32.325156 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c4bfb-0eac-4a8e-8b41-3b132548f19c service placement] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:32.349623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dbf3d-3eeb-48b3-8ae8-fcdcab433454 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:32.351380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-740dbf3d-3eeb-48b3-8ae8-fcdcab433454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:32.362321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1144/2316] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:32.377795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dbf3d-3eeb-48b3-8ae8-fcdcab433454 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:32.388193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:32.388193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:32.388193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:32.388193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] PATH_INFO: `/v3/users/c4415fe3e3704fde82f2dea0622d725f` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:32.388960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4415fe3e3704fde82f2dea0622d725f)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:32.388960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:32.641893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4415fe3e3704fde82f2dea0622d725f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:32.652076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4415fe3e3704fde82f2dea0622d725f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:32.751586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4415fe3e3704fde82f2dea0622d725f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:32.752990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4415fe3e3704fde82f2dea0622d725f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:32.753982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7fe3c75b-1a32-443b-937d-e531b886125f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4415fe3e3704fde82f2dea0622d725f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:32.814218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1173/2317] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:32 2022] DELETE /identity/v3/users/c4415fe3e3704fde82f2dea0622d725f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:33.413454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c4bfb-0eac-4a8e-8b41-3b132548f19c service placement] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:33.451982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c4bfb-0eac-4a8e-8b41-3b132548f19c service placement] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:33.641824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:33.646253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:33.648765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:33.649710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] PATH_INFO: `/v3/projects/77e721475b1045d1a1602dc697362f2f` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:33.653134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e721475b1045d1a1602dc697362f2f)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:33.657150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:33.878910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e721475b1045d1a1602dc697362f2f', 'request_id': 'req-4ee6a3c7-815e-4092-b077-5854f4c0761d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:34.033027 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e721475b1045d1a1602dc697362f2f', 'request_id': 'req-4ee6a3c7-815e-4092-b077-5854f4c0761d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:34.043465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e721475b1045d1a1602dc697362f2f', 'request_id': 'req-4ee6a3c7-815e-4092-b077-5854f4c0761d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:34.084377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] The token cache is being invalidate because project 77e721475b1045d1a1602dc697362f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:34.087711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:34.092505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4ee6a3c7-815e-4092-b077-5854f4c0761d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:34.098881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1145/2318] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:33 2022] DELETE /identity/v3/projects/77e721475b1045d1a1602dc697362f2f => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:34.110820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90df00-c12c-41f6-808e-9be89545dafc None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:34.112715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90df00-c12c-41f6-808e-9be89545dafc None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:34.113460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90df00-c12c-41f6-808e-9be89545dafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:34.236983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-ac90df00-c12c-41f6-808e-9be89545dafc None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:34.238698 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ac90df00-c12c-41f6-808e-9be89545dafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:34.372052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:34.606211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1174/2319] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:34.615854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e6d95-cd3c-4c25-a102-5585d32f0615 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:34.620457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e6d95-cd3c-4c25-a102-5585d32f0615 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:34.620457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e6d95-cd3c-4c25-a102-5585d32f0615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:34.661917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-f92e6d95-cd3c-4c25-a102-5585d32f0615 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:34.663099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f92e6d95-cd3c-4c25-a102-5585d32f0615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:34.671659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1146/2320] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:34.676404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90df00-c12c-41f6-808e-9be89545dafc None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:34.695103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90df00-c12c-41f6-808e-9be89545dafc None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:34.703659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bec4a-619e-45fa-94ce-afaa53e8d018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:34.709275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bec4a-619e-45fa-94ce-afaa53e8d018 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:34.709693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bec4a-619e-45fa-94ce-afaa53e8d018 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:34.709959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bec4a-619e-45fa-94ce-afaa53e8d018 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:34.710656 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bec4a-619e-45fa-94ce-afaa53e8d018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:34.710960 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bec4a-619e-45fa-94ce-afaa53e8d018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:34.712668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bec4a-619e-45fa-94ce-afaa53e8d018 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:34.730146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1175/2321] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:03:34.736572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e6d95-cd3c-4c25-a102-5585d32f0615 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:34.747880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e6d95-cd3c-4c25-a102-5585d32f0615 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:34.763662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc59ea-41c2-401c-8f5b-bd38ca76fb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:34.764445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc59ea-41c2-401c-8f5b-bd38ca76fb06 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:34.765384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc59ea-41c2-401c-8f5b-bd38ca76fb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:34.765575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc59ea-41c2-401c-8f5b-bd38ca76fb06 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:34.766819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc59ea-41c2-401c-8f5b-bd38ca76fb06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:34.769261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc59ea-41c2-401c-8f5b-bd38ca76fb06 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:35.010287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1147/2322] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:34 2022] POST /identity/v3/projects => generated 371 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:35.010515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bec4a-619e-45fa-94ce-afaa53e8d018 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:35.010515 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bec4a-619e-45fa-94ce-afaa53e8d018 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:35.045609 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc59ea-41c2-401c-8f5b-bd38ca76fb06 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:35.048869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-cccc59ea-41c2-401c-8f5b-bd38ca76fb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:35.057864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:35.155153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc59ea-41c2-401c-8f5b-bd38ca76fb06 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:35.161674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dcf2f-c91e-438e-9fc6-e9b43b4d8316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:35.162485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dcf2f-c91e-438e-9fc6-e9b43b4d8316 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:35.179437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dcf2f-c91e-438e-9fc6-e9b43b4d8316 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:35.180239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dcf2f-c91e-438e-9fc6-e9b43b4d8316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:35.183762 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e20f4f-eb30-4a8a-a10b-8d2e456ed65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:35.185477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e20f4f-eb30-4a8a-a10b-8d2e456ed65e admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:35.186021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e20f4f-eb30-4a8a-a10b-8d2e456ed65e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:35.186370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3a2dcf2f-c91e-438e-9fc6-e9b43b4d8316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:35.186770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e20f4f-eb30-4a8a-a10b-8d2e456ed65e admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:35.188305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e20f4f-eb30-4a8a-a10b-8d2e456ed65e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:35.199089 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e20f4f-eb30-4a8a-a10b-8d2e456ed65e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:35.225121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dcf2f-c91e-438e-9fc6-e9b43b4d8316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:35.228010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2dcf2f-c91e-438e-9fc6-e9b43b4d8316 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:35.242327 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1148/2323] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:35.330176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1176/2324] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:34 2022] POST /identity/v3/users => generated 286 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:35.335080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dcf2f-c91e-438e-9fc6-e9b43b4d8316 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:35.356550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2dcf2f-c91e-438e-9fc6-e9b43b4d8316 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:35.370741 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83ac2-6ede-4b7a-b269-3b1c9025f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:35.375673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83ac2-6ede-4b7a-b269-3b1c9025f093 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:35.375673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83ac2-6ede-4b7a-b269-3b1c9025f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:35.375673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83ac2-6ede-4b7a-b269-3b1c9025f093 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:35.375673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e83ac2-6ede-4b7a-b269-3b1c9025f093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:35.377400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e83ac2-6ede-4b7a-b269-3b1c9025f093 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:35.401899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1149/2325] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:35.406358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e20f4f-eb30-4a8a-a10b-8d2e456ed65e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:35.427667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e20f4f-eb30-4a8a-a10b-8d2e456ed65e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:35.438995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c910e-d21c-4032-a07d-d2b01274d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:35.443283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c910e-d21c-4032-a07d-d2b01274d819 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:35.445292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c910e-d21c-4032-a07d-d2b01274d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:35.445707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c910e-d21c-4032-a07d-d2b01274d819 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:35.446746 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c910e-d21c-4032-a07d-d2b01274d819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:35.452042 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c910e-d21c-4032-a07d-d2b01274d819 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:35.486525 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1177/2326] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:35.491119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83ac2-6ede-4b7a-b269-3b1c9025f093 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:35.510257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83ac2-6ede-4b7a-b269-3b1c9025f093 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:35.522822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021cb71-ff8f-4ea7-92ab-b428789a91d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:35.525194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021cb71-ff8f-4ea7-92ab-b428789a91d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:35.525391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021cb71-ff8f-4ea7-92ab-b428789a91d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:35.526660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021cb71-ff8f-4ea7-92ab-b428789a91d3 admin admin] PATH_INFO: `/v3/projects/e3c4044bb98d4b78bb67ad669fb00fc8/users/2b57af92a658438c8650e8fec64302ea/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:35.570421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021cb71-ff8f-4ea7-92ab-b428789a91d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c4044bb98d4b78bb67ad669fb00fc8, user_id=2b57af92a658438c8650e8fec64302ea, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:35.574616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021cb71-ff8f-4ea7-92ab-b428789a91d3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:35.743816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1150/2327] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:35 2022] PUT /identity/v3/projects/e3c4044bb98d4b78bb67ad669fb00fc8/users/2b57af92a658438c8650e8fec64302ea/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:35.760892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96356ee3-8184-439a-9a87-6d8023d920b4 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:35.760892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96356ee3-8184-439a-9a87-6d8023d920b4 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:35.761543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96356ee3-8184-439a-9a87-6d8023d920b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:35.821472 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-96356ee3-8184-439a-9a87-6d8023d920b4 None None] MFA Rules not processed for user `2b57af92a658438c8650e8fec64302ea`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:35.823395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-96356ee3-8184-439a-9a87-6d8023d920b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:35.939722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:35.996430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1178/2328] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:36.021707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021cb71-ff8f-4ea7-92ab-b428789a91d3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:36.026502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f021cb71-ff8f-4ea7-92ab-b428789a91d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:36.263821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021cb71-ff8f-4ea7-92ab-b428789a91d3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:36.283626 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666a8b3-4a1a-40e8-bbfc-f08971d63a5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:36.284360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666a8b3-4a1a-40e8-bbfc-f08971d63a5a service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:36.287128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666a8b3-4a1a-40e8-bbfc-f08971d63a5a service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:36.287453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666a8b3-4a1a-40e8-bbfc-f08971d63a5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:36.306698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666a8b3-4a1a-40e8-bbfc-f08971d63a5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:36.310449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666a8b3-4a1a-40e8-bbfc-f08971d63a5a service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:36.321710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1151/2329] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:39.923662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96356ee3-8184-439a-9a87-6d8023d920b4 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:39.925291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-96356ee3-8184-439a-9a87-6d8023d920b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:40.009507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96356ee3-8184-439a-9a87-6d8023d920b4 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.015296 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.016059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.016404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.016757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] PATH_INFO: `/v3/users/d630b75517634f6e9cf0613661fb7695` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.018227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d630b75517634f6e9cf0613661fb7695)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.020758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:40.287453 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd630b75517634f6e9cf0613661fb7695'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:40.311771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd630b75517634f6e9cf0613661fb7695'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:40.417060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd630b75517634f6e9cf0613661fb7695'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:40.419542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd630b75517634f6e9cf0613661fb7695'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:40.420720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd630b75517634f6e9cf0613661fb7695'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:40.457130 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1179/2330] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:39 2022] DELETE /identity/v3/users/d630b75517634f6e9cf0613661fb7695 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:40.776487 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666a8b3-4a1a-40e8-bbfc-f08971d63a5a service nova] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:40.786273 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666a8b3-4a1a-40e8-bbfc-f08971d63a5a service nova] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.860701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:40.869839 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.870731 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.871114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.871489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] PATH_INFO: `/v3/users/2b57af92a658438c8650e8fec64302ea` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.872908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b57af92a658438c8650e8fec64302ea)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.875455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:40.952894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:40.954584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:40.972483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b50726-40bc-49f8-af34-9c29fadf37fe admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.986683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.987688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.987973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.988246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] PATH_INFO: `/v3/projects/cc986b271ecc4ef1880077175d546b04` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.990185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc986b271ecc4ef1880077175d546b04)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.996137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:41.143058 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc986b271ecc4ef1880077175d546b04', 'request_id': 'req-2c60443d-17cd-4481-8faa-2d6dd7751bc2'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.151131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b57af92a658438c8650e8fec64302ea'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.155936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc986b271ecc4ef1880077175d546b04', 'request_id': 'req-2c60443d-17cd-4481-8faa-2d6dd7751bc2'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.161188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:41.165918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc986b271ecc4ef1880077175d546b04', 'request_id': 'req-2c60443d-17cd-4481-8faa-2d6dd7751bc2'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.170078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b57af92a658438c8650e8fec64302ea'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.300847 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] The token cache is being invalidate because project cc986b271ecc4ef1880077175d546b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:41.301133 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.301809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2c60443d-17cd-4481-8faa-2d6dd7751bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.303316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1180/2331] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:40 2022] DELETE /identity/v3/projects/cc986b271ecc4ef1880077175d546b04 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:41.308120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc02b1-58a7-42b8-b709-3876f954d1b1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.308465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc02b1-58a7-42b8-b709-3876f954d1b1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.310560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc02b1-58a7-42b8-b709-3876f954d1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:41.335310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4ddc02b1-58a7-42b8-b709-3876f954d1b1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:41.336597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4ddc02b1-58a7-42b8-b709-3876f954d1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:41.362923 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b57af92a658438c8650e8fec64302ea'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.365271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b57af92a658438c8650e8fec64302ea'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.376203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6f31dd6c-18fd-4d93-87cd-b4cc02c2b61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b57af92a658438c8650e8fec64302ea'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.387456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1152/2332] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:40 2022] DELETE /identity/v3/users/2b57af92a658438c8650e8fec64302ea => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:41.389246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a01b8-d9ac-4f28-9f47-41ae6d09af9c None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.389755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a01b8-d9ac-4f28-9f47-41ae6d09af9c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.390264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a01b8-d9ac-4f28-9f47-41ae6d09af9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:41.413693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-239a01b8-d9ac-4f28-9f47-41ae6d09af9c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:41.415076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-239a01b8-d9ac-4f28-9f47-41ae6d09af9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:41.454989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1181/2333] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:41.464769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf298b1-9c6d-4eb5-b056-841d8076ae44 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.465245 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf298b1-9c6d-4eb5-b056-841d8076ae44 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.465642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf298b1-9c6d-4eb5-b056-841d8076ae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:41.498133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1153/2334] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:41.511942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a01b8-d9ac-4f28-9f47-41ae6d09af9c None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:41.513900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-239a01b8-d9ac-4f28-9f47-41ae6d09af9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:41.514972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4cf298b1-9c6d-4eb5-b056-841d8076ae44 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:41.516196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4cf298b1-9c6d-4eb5-b056-841d8076ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:41.539803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1182/2335] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:41.542176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf298b1-9c6d-4eb5-b056-841d8076ae44 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:41.565194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf298b1-9c6d-4eb5-b056-841d8076ae44 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:41.576743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c61fa2-a778-4d86-9b4f-efeb259c1585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:41.576743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c61fa2-a778-4d86-9b4f-efeb259c1585 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.576743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c61fa2-a778-4d86-9b4f-efeb259c1585 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.576743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c61fa2-a778-4d86-9b4f-efeb259c1585 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:41.577244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c61fa2-a778-4d86-9b4f-efeb259c1585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:41.577244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c61fa2-a778-4d86-9b4f-efeb259c1585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:41.577244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c61fa2-a778-4d86-9b4f-efeb259c1585 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:41.599111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1183/2336] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:41.600851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a01b8-d9ac-4f28-9f47-41ae6d09af9c None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:41.603851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c61fa2-a778-4d86-9b4f-efeb259c1585 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:41.605061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b32198-00ae-4d8f-b443-30b45b31825b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:41.605684 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b32198-00ae-4d8f-b443-30b45b31825b service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.605964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b32198-00ae-4d8f-b443-30b45b31825b service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.606243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b32198-00ae-4d8f-b443-30b45b31825b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:41.616824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c61fa2-a778-4d86-9b4f-efeb259c1585 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:41.621150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b32198-00ae-4d8f-b443-30b45b31825b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:41.623392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b32198-00ae-4d8f-b443-30b45b31825b service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:41.624307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f867f6-7d69-4e47-be67-2641c63ed066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:41.625103 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f867f6-7d69-4e47-be67-2641c63ed066 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.625477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f867f6-7d69-4e47-be67-2641c63ed066 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.625842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f867f6-7d69-4e47-be67-2641c63ed066 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:41.626574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f867f6-7d69-4e47-be67-2641c63ed066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:41.628742 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f867f6-7d69-4e47-be67-2641c63ed066 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:41.637909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1154/2337] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:41.813795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1184/2338] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:41 2022] POST /identity/v3/projects => generated 363 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:41.819500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b32198-00ae-4d8f-b443-30b45b31825b service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:41.856032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b32198-00ae-4d8f-b443-30b45b31825b service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:41.913436 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:41.997207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889148c-db30-49a4-85ca-e278397d1ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:41.998161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889148c-db30-49a4-85ca-e278397d1ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.999161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889148c-db30-49a4-85ca-e278397d1ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.999655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889148c-db30-49a4-85ca-e278397d1ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.000568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889148c-db30-49a4-85ca-e278397d1ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.003818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889148c-db30-49a4-85ca-e278397d1ca2 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.220577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f867f6-7d69-4e47-be67-2641c63ed066 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.227293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1155/2339] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:41 2022] POST /identity/v3/users => generated 282 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:42.240584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f867f6-7d69-4e47-be67-2641c63ed066 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.262416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c099e7-6b9b-4b9a-acaa-33cd4c1ded12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.263350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c099e7-6b9b-4b9a-acaa-33cd4c1ded12 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.264393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c099e7-6b9b-4b9a-acaa-33cd4c1ded12 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.264393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c099e7-6b9b-4b9a-acaa-33cd4c1ded12 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.266067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c099e7-6b9b-4b9a-acaa-33cd4c1ded12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.269143 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c099e7-6b9b-4b9a-acaa-33cd4c1ded12 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.299482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1185/2340] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:42.303803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889148c-db30-49a4-85ca-e278397d1ca2 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.315966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889148c-db30-49a4-85ca-e278397d1ca2 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.336474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319457d-c448-4f21-a7f4-b61cce9202ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.336474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319457d-c448-4f21-a7f4-b61cce9202ca admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.336474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319457d-c448-4f21-a7f4-b61cce9202ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.336474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319457d-c448-4f21-a7f4-b61cce9202ca admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.336874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319457d-c448-4f21-a7f4-b61cce9202ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.336874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319457d-c448-4f21-a7f4-b61cce9202ca admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.340783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1156/2341] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:42.342741 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c099e7-6b9b-4b9a-acaa-33cd4c1ded12 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.357097 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c099e7-6b9b-4b9a-acaa-33cd4c1ded12 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.365157 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745199c-2c48-407b-8840-87ea0c3bdc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.366837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745199c-2c48-407b-8840-87ea0c3bdc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.372289 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745199c-2c48-407b-8840-87ea0c3bdc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.372289 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745199c-2c48-407b-8840-87ea0c3bdc53 admin admin] PATH_INFO: `/v3/projects/769ace9c3ba34fbfa402b7326fb339dc/users/c91b7021353a4a6c9535a2f0d832234e/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.405656 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745199c-2c48-407b-8840-87ea0c3bdc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769ace9c3ba34fbfa402b7326fb339dc, user_id=c91b7021353a4a6c9535a2f0d832234e, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.409319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745199c-2c48-407b-8840-87ea0c3bdc53 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.472786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319457d-c448-4f21-a7f4-b61cce9202ca admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.475194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1319457d-c448-4f21-a7f4-b61cce9202ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.515531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319457d-c448-4f21-a7f4-b61cce9202ca admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.522345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.522732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.523010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.523283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] PATH_INFO: `/v3/projects/e3c4044bb98d4b78bb67ad669fb00fc8` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.524920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c4044bb98d4b78bb67ad669fb00fc8)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.527857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.565258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1186/2342] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:42 2022] PUT /identity/v3/projects/769ace9c3ba34fbfa402b7326fb339dc/users/c91b7021353a4a6c9535a2f0d832234e/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:42.576959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07441f4a-9b0e-418f-a758-f4c22ef67123 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.578241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07441f4a-9b0e-418f-a758-f4c22ef67123 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.578241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07441f4a-9b0e-418f-a758-f4c22ef67123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.643545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-07441f4a-9b0e-418f-a758-f4c22ef67123 None None] MFA Rules not processed for user `c91b7021353a4a6c9535a2f0d832234e`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:42.645080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-07441f4a-9b0e-418f-a758-f4c22ef67123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.692722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c4044bb98d4b78bb67ad669fb00fc8', 'request_id': 'req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.750820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:42.760803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1187/2343] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:42.765888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07441f4a-9b0e-418f-a758-f4c22ef67123 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.846795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07441f4a-9b0e-418f-a758-f4c22ef67123 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.848775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c4044bb98d4b78bb67ad669fb00fc8', 'request_id': 'req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.869533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c4044bb98d4b78bb67ad669fb00fc8', 'request_id': 'req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.892910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] The token cache is being invalidate because project e3c4044bb98d4b78bb67ad669fb00fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:42.896750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.896750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-24e0a201-b7f2-4d7e-923b-cbe58afdaccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.913517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1157/2344] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:42 2022] DELETE /identity/v3/projects/e3c4044bb98d4b78bb67ad669fb00fc8 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:42.919570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555f269-0a8e-4f53-9ecb-7e9f44d01bd2 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.920178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555f269-0a8e-4f53-9ecb-7e9f44d01bd2 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.921220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555f269-0a8e-4f53-9ecb-7e9f44d01bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.945513 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a05e4-51dc-4fde-9c50-c76b5ad1df52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.946672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a05e4-51dc-4fde-9c50-c76b5ad1df52 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.947038 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a05e4-51dc-4fde-9c50-c76b5ad1df52 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.947716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a05e4-51dc-4fde-9c50-c76b5ad1df52 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.948813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a05e4-51dc-4fde-9c50-c76b5ad1df52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.950930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a05e4-51dc-4fde-9c50-c76b5ad1df52 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.977686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b555f269-0a8e-4f53-9ecb-7e9f44d01bd2 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:42.978944 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b555f269-0a8e-4f53-9ecb-7e9f44d01bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.992743 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1158/2345] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:43.001415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094a491-8893-4ffd-94d9-302f93fa915e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.001704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094a491-8893-4ffd-94d9-302f93fa915e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.002207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094a491-8893-4ffd-94d9-302f93fa915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.027148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-1094a491-8893-4ffd-94d9-302f93fa915e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:43.028918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1094a491-8893-4ffd-94d9-302f93fa915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.038657 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1159/2346] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:43.043260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094a491-8893-4ffd-94d9-302f93fa915e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.057793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094a491-8893-4ffd-94d9-302f93fa915e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.069398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1188/2347] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:42 2022] POST /identity/v3/projects => generated 363 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:43.070833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a05e4-51dc-4fde-9c50-c76b5ad1df52 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.072087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9030c-d623-4c35-828e-47ac6b050575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.072750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9030c-d623-4c35-828e-47ac6b050575 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.073151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9030c-d623-4c35-828e-47ac6b050575 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.073283 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9030c-d623-4c35-828e-47ac6b050575 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.073602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-cd9a05e4-51dc-4fde-9c50-c76b5ad1df52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.073948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9030c-d623-4c35-828e-47ac6b050575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:43.074246 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9030c-d623-4c35-828e-47ac6b050575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.075874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9030c-d623-4c35-828e-47ac6b050575 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.088917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1160/2348] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:03:43.098802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9030c-d623-4c35-828e-47ac6b050575 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.109973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9030c-d623-4c35-828e-47ac6b050575 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.162018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a05e4-51dc-4fde-9c50-c76b5ad1df52 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.169724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a89c1-f36b-4a97-9b71-93380df561fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.170838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a89c1-f36b-4a97-9b71-93380df561fa admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.171832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a89c1-f36b-4a97-9b71-93380df561fa admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.172368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a89c1-f36b-4a97-9b71-93380df561fa admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.173616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a89c1-f36b-4a97-9b71-93380df561fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.177789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a89c1-f36b-4a97-9b71-93380df561fa admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.198642 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182f9a0-761f-4862-88c4-7001e788e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.199471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182f9a0-761f-4862-88c4-7001e788e63b admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.200808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182f9a0-761f-4862-88c4-7001e788e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.201169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182f9a0-761f-4862-88c4-7001e788e63b admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.204824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182f9a0-761f-4862-88c4-7001e788e63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.207139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d182f9a0-761f-4862-88c4-7001e788e63b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.275090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1189/2349] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:43 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:43.281596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a89c1-f36b-4a97-9b71-93380df561fa admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.302062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a89c1-f36b-4a97-9b71-93380df561fa admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.305627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafce567-c05a-40fc-9dfd-031d3308b343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.306516 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce567-c05a-40fc-9dfd-031d3308b343 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.306959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce567-c05a-40fc-9dfd-031d3308b343 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.307468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce567-c05a-40fc-9dfd-031d3308b343 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.308289 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafce567-c05a-40fc-9dfd-031d3308b343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.310665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafce567-c05a-40fc-9dfd-031d3308b343 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.329783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1190/2350] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:43.330857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1161/2351] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:43 2022] POST /identity/v3/projects => generated 365 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:43.334714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafce567-c05a-40fc-9dfd-031d3308b343 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.336781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182f9a0-761f-4862-88c4-7001e788e63b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.353631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafce567-c05a-40fc-9dfd-031d3308b343 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.414193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182f9a0-761f-4862-88c4-7001e788e63b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.420859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31224c99-5780-4c82-9705-aac021adc3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.421567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31224c99-5780-4c82-9705-aac021adc3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.421922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31224c99-5780-4c82-9705-aac021adc3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.422268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31224c99-5780-4c82-9705-aac021adc3d9 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.422976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31224c99-5780-4c82-9705-aac021adc3d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.425266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31224c99-5780-4c82-9705-aac021adc3d9 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.491011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736bfae-ac66-4eda-a3ba-ed575d4683b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.491689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736bfae-ac66-4eda-a3ba-ed575d4683b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.491973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736bfae-ac66-4eda-a3ba-ed575d4683b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.492295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736bfae-ac66-4eda-a3ba-ed575d4683b7 admin admin] PATH_INFO: `/v3/projects/1fcfb13b67fb4dd5bdd5c38a8d141893/users/215860a0011b4439bbc2c81eabe7609a/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.514924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736bfae-ac66-4eda-a3ba-ed575d4683b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fcfb13b67fb4dd5bdd5c38a8d141893, user_id=215860a0011b4439bbc2c81eabe7609a, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.519411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736bfae-ac66-4eda-a3ba-ed575d4683b7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.569481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1162/2352] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:43 2022] POST /identity/v3/users => generated 283 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:43.575443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31224c99-5780-4c82-9705-aac021adc3d9 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.595870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31224c99-5780-4c82-9705-aac021adc3d9 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.598643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b972d9-2f32-479c-818e-d86906f102fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.599593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b972d9-2f32-479c-818e-d86906f102fc admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.599872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b972d9-2f32-479c-818e-d86906f102fc admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.600139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b972d9-2f32-479c-818e-d86906f102fc admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.601106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b972d9-2f32-479c-818e-d86906f102fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.602886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b972d9-2f32-479c-818e-d86906f102fc admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.612549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:43.621471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1163/2353] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:43.625988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b972d9-2f32-479c-818e-d86906f102fc admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.640660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b972d9-2f32-479c-818e-d86906f102fc admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.646914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349af2f4-7144-4389-a8ef-17c57fa3af3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.647680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af2f4-7144-4389-a8ef-17c57fa3af3c admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.648023 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af2f4-7144-4389-a8ef-17c57fa3af3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.648399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af2f4-7144-4389-a8ef-17c57fa3af3c admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.649607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349af2f4-7144-4389-a8ef-17c57fa3af3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.652929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349af2f4-7144-4389-a8ef-17c57fa3af3c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.673268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1191/2354] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:43 2022] PUT /identity/v3/projects/1fcfb13b67fb4dd5bdd5c38a8d141893/users/215860a0011b4439bbc2c81eabe7609a/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:43.678856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736bfae-ac66-4eda-a3ba-ed575d4683b7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.697135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1164/2355] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:43.704841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349af2f4-7144-4389-a8ef-17c57fa3af3c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.722993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349af2f4-7144-4389-a8ef-17c57fa3af3c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.825207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736bfae-ac66-4eda-a3ba-ed575d4683b7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.825207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63d0f4-9b4e-4e69-8b0d-f9126ae13688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.825207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d0f4-9b4e-4e69-8b0d-f9126ae13688 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.825207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d0f4-9b4e-4e69-8b0d-f9126ae13688 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.825702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d0f4-9b4e-4e69-8b0d-f9126ae13688 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.826278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63d0f4-9b4e-4e69-8b0d-f9126ae13688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.828700 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63d0f4-9b4e-4e69-8b0d-f9126ae13688 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.848922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1192/2356] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:43.851059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63d0f4-9b4e-4e69-8b0d-f9126ae13688 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.854505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c907ce-3048-4d48-8d37-798aa7426a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.855110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c907ce-3048-4d48-8d37-798aa7426a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.855432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c907ce-3048-4d48-8d37-798aa7426a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.855753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c907ce-3048-4d48-8d37-798aa7426a53 admin admin] PATH_INFO: `/v3/projects/cf2fe11cd4b24e45a20f7cb4a8fe6922/users/7f1c774c849145348046b5080f0ca6fa/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.892789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63d0f4-9b4e-4e69-8b0d-f9126ae13688 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.894133 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b949d-6ccd-46a1-868d-da88fbba0ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.894826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b949d-6ccd-46a1-868d-da88fbba0ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.895205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b949d-6ccd-46a1-868d-da88fbba0ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.895361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c907ce-3048-4d48-8d37-798aa7426a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2fe11cd4b24e45a20f7cb4a8fe6922, user_id=7f1c774c849145348046b5080f0ca6fa, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.895478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b949d-6ccd-46a1-868d-da88fbba0ad0 admin admin] PATH_INFO: `/v3/projects/1fcfb13b67fb4dd5bdd5c38a8d141893/users/215860a0011b4439bbc2c81eabe7609a/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.897834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b949d-6ccd-46a1-868d-da88fbba0ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fcfb13b67fb4dd5bdd5c38a8d141893, user_id=215860a0011b4439bbc2c81eabe7609a, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.900317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b949d-6ccd-46a1-868d-da88fbba0ad0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.901271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c907ce-3048-4d48-8d37-798aa7426a53 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.912711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1193/2357] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:43 2022] PUT /identity/v3/projects/1fcfb13b67fb4dd5bdd5c38a8d141893/users/215860a0011b4439bbc2c81eabe7609a/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:43.926342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f4df7-3e2b-4431-b1bc-96a0e113048f None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.926626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f4df7-3e2b-4431-b1bc-96a0e113048f None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.931146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f4df7-3e2b-4431-b1bc-96a0e113048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.991641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-110f4df7-3e2b-4431-b1bc-96a0e113048f None None] MFA Rules not processed for user `215860a0011b4439bbc2c81eabe7609a`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:43.993162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-110f4df7-3e2b-4431-b1bc-96a0e113048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.017952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1165/2358] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:43 2022] PUT /identity/v3/projects/cf2fe11cd4b24e45a20f7cb4a8fe6922/users/7f1c774c849145348046b5080f0ca6fa/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:44.029998 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c961b-657b-42f0-9736-c8523043dd22 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.031944 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c961b-657b-42f0-9736-c8523043dd22 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.033102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c961b-657b-42f0-9736-c8523043dd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.090029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-e95c961b-657b-42f0-9736-c8523043dd22 None None] MFA Rules not processed for user `7f1c774c849145348046b5080f0ca6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:44.092021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e95c961b-657b-42f0-9736-c8523043dd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.156329 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1194/2359] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:44.175488 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f4df7-3e2b-4431-b1bc-96a0e113048f None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.178569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-110f4df7-3e2b-4431-b1bc-96a0e113048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.193096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1166/2360] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:44.197581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c961b-657b-42f0-9736-c8523043dd22 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.256612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f4df7-3e2b-4431-b1bc-96a0e113048f None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.283302 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c961b-657b-42f0-9736-c8523043dd22 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.288578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da39f87-a84a-4f5d-b901-2201c5c2ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.289267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da39f87-a84a-4f5d-b901-2201c5c2ff04 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.289542 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da39f87-a84a-4f5d-b901-2201c5c2ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.289819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da39f87-a84a-4f5d-b901-2201c5c2ff04 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.290470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da39f87-a84a-4f5d-b901-2201c5c2ff04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.292460 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da39f87-a84a-4f5d-b901-2201c5c2ff04 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.318943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ca992-2611-47a3-8952-2d4852205121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.319574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ca992-2611-47a3-8952-2d4852205121 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.319842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ca992-2611-47a3-8952-2d4852205121 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.320109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ca992-2611-47a3-8952-2d4852205121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.335118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:44.391868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ca992-2611-47a3-8952-2d4852205121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.398372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ca992-2611-47a3-8952-2d4852205121 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.398537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1167/2361] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:44 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:44.399142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da39f87-a84a-4f5d-b901-2201c5c2ff04 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.412830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1195/2362] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:44.470772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da39f87-a84a-4f5d-b901-2201c5c2ff04 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.476598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0d5cd-bfbc-4158-b13d-88aba1b53fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.477284 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d5cd-bfbc-4158-b13d-88aba1b53fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.477677 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d5cd-bfbc-4158-b13d-88aba1b53fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.477997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d5cd-bfbc-4158-b13d-88aba1b53fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.478639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0d5cd-bfbc-4158-b13d-88aba1b53fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.480683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0d5cd-bfbc-4158-b13d-88aba1b53fe1 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.572583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1168/2363] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:44 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:44.577175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ca992-2611-47a3-8952-2d4852205121 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.589285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ca992-2611-47a3-8952-2d4852205121 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.595915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc9280-7d4b-42d6-b4b0-1fd018e5a40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.600241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc9280-7d4b-42d6-b4b0-1fd018e5a40f admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.600241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc9280-7d4b-42d6-b4b0-1fd018e5a40f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.600241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc9280-7d4b-42d6-b4b0-1fd018e5a40f admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.600241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc9280-7d4b-42d6-b4b0-1fd018e5a40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.600241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc9280-7d4b-42d6-b4b0-1fd018e5a40f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.615717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1196/2364] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:44.618990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0d5cd-bfbc-4158-b13d-88aba1b53fe1 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.629678 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0d5cd-bfbc-4158-b13d-88aba1b53fe1 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.634902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9cc7d-3586-4ca7-9376-644bec14292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.635518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9cc7d-3586-4ca7-9376-644bec14292f admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.635797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9cc7d-3586-4ca7-9376-644bec14292f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.636066 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9cc7d-3586-4ca7-9376-644bec14292f admin admin] PATH_INFO: `/v3/projects/76b743bdf8674697b518903809d533f2/users/020286d3d5414ce69bf0eaa8323b17e1/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.657018 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9cc7d-3586-4ca7-9376-644bec14292f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b743bdf8674697b518903809d533f2, user_id=020286d3d5414ce69bf0eaa8323b17e1, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.659850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9cc7d-3586-4ca7-9376-644bec14292f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.716794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc9280-7d4b-42d6-b4b0-1fd018e5a40f admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.762108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1169/2365] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:44 2022] PUT /identity/v3/projects/76b743bdf8674697b518903809d533f2/users/020286d3d5414ce69bf0eaa8323b17e1/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:44.768299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9cc7d-3586-4ca7-9376-644bec14292f admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.794146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc9280-7d4b-42d6-b4b0-1fd018e5a40f admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.846392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9cc7d-3586-4ca7-9376-644bec14292f admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.851992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf8a8-493e-4e84-9fee-60ab925454a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.852983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf8a8-493e-4e84-9fee-60ab925454a0 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.853262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf8a8-493e-4e84-9fee-60ab925454a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.853543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebf8a8-493e-4e84-9fee-60ab925454a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.854202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebf8a8-493e-4e84-9fee-60ab925454a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.855957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebf8a8-493e-4e84-9fee-60ab925454a0 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.858975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380337f8-5c57-4bb4-ac85-01f35d7fe87c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.859939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380337f8-5c57-4bb4-ac85-01f35d7fe87c service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.860665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380337f8-5c57-4bb4-ac85-01f35d7fe87c service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.861354 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380337f8-5c57-4bb4-ac85-01f35d7fe87c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.863086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-380337f8-5c57-4bb4-ac85-01f35d7fe87c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.868546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1170/2366] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:44.872775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf8a8-493e-4e84-9fee-60ab925454a0 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.884150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebf8a8-493e-4e84-9fee-60ab925454a0 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.889880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8f520-c689-405d-a0f2-f77506e319bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.890492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f520-c689-405d-a0f2-f77506e319bd admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.890774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f520-c689-405d-a0f2-f77506e319bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.891045 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f520-c689-405d-a0f2-f77506e319bd admin admin] PATH_INFO: `/v3/projects/76b743bdf8674697b518903809d533f2/users/020286d3d5414ce69bf0eaa8323b17e1/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.896562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f520-c689-405d-a0f2-f77506e319bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b743bdf8674697b518903809d533f2, user_id=020286d3d5414ce69bf0eaa8323b17e1, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.896562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f520-c689-405d-a0f2-f77506e319bd admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.908704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1171/2367] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:44 2022] PUT /identity/v3/projects/76b743bdf8674697b518903809d533f2/users/020286d3d5414ce69bf0eaa8323b17e1/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:44.926406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c520-f9cf-444b-b93e-cd5ca3a5cd1d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.928868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c520-f9cf-444b-b93e-cd5ca3a5cd1d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.928868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c520-f9cf-444b-b93e-cd5ca3a5cd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.947553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380337f8-5c57-4bb4-ac85-01f35d7fe87c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.949844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380337f8-5c57-4bb4-ac85-01f35d7fe87c service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.962356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-50b4c520-f9cf-444b-b93e-cd5ca3a5cd1d None None] MFA Rules not processed for user `020286d3d5414ce69bf0eaa8323b17e1`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:44.965534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-50b4c520-f9cf-444b-b93e-cd5ca3a5cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.976782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1197/2368] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:45.034988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:45.062242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:45.077838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1172/2369] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:45.122548 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380337f8-5c57-4bb4-ac85-01f35d7fe87c service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:45.125500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-380337f8-5c57-4bb4-ac85-01f35d7fe87c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:45.141116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380337f8-5c57-4bb4-ac85-01f35d7fe87c service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:45.213048 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea63283-a83e-459a-bce1-1ab303d93e04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:45.215181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea63283-a83e-459a-bce1-1ab303d93e04 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:45.216225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea63283-a83e-459a-bce1-1ab303d93e04 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:45.216694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea63283-a83e-459a-bce1-1ab303d93e04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:45.228351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea63283-a83e-459a-bce1-1ab303d93e04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:45.229882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea63283-a83e-459a-bce1-1ab303d93e04 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:45.240124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1198/2370] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:46.077200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:46.117382 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:46.634108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4c520-f9cf-444b-b93e-cd5ca3a5cd1d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:46.726968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4c520-f9cf-444b-b93e-cd5ca3a5cd1d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:46.732275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:46.733453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:46.733945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:46.734459 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] PATH_INFO: `/v3/users/7f1c774c849145348046b5080f0ca6fa` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:46.736581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1c774c849145348046b5080f0ca6fa)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:46.739962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:46.772496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:47.036497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1c774c849145348046b5080f0ca6fa'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.069747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1c774c849145348046b5080f0ca6fa'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.140538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1c774c849145348046b5080f0ca6fa'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.141729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1c774c849145348046b5080f0ca6fa'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.151464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1c774c849145348046b5080f0ca6fa'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.158491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1173/2371] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:46 2022] DELETE /identity/v3/users/7f1c774c849145348046b5080f0ca6fa => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:47.163202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb303-ecf9-43d6-94de-47e875651a74 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:47.163725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb303-ecf9-43d6-94de-47e875651a74 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:47.163725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fb303-ecf9-43d6-94de-47e875651a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:47.207079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d72fb303-ecf9-43d6-94de-47e875651a74 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:47.208352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d72fb303-ecf9-43d6-94de-47e875651a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:47.297513 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1199/2372] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:47.310954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:47.313252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:47.325491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8588-3804-4c0b-82fe-b6eb8a1edfb3 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:47.328731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8588-3804-4c0b-82fe-b6eb8a1edfb3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:47.328731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af8588-3804-4c0b-82fe-b6eb8a1edfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:47.365865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c3af8588-3804-4c0b-82fe-b6eb8a1edfb3 None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:47.367975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c3af8588-3804-4c0b-82fe-b6eb8a1edfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:47.376778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:47.413032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4723192-fe19-4ab0-960b-6d1efee0306c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:47.417917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea562baf-7db3-4dd4-9393-e0c600995f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:47.418736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea562baf-7db3-4dd4-9393-e0c600995f85 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:47.419162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea562baf-7db3-4dd4-9393-e0c600995f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:47.419605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea562baf-7db3-4dd4-9393-e0c600995f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:47.431400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea562baf-7db3-4dd4-9393-e0c600995f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:47.433174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea562baf-7db3-4dd4-9393-e0c600995f85 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:47.435717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1200/2373] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 16:03:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:47.446147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1174/2374] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:47.451175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af8588-3804-4c0b-82fe-b6eb8a1edfb3 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:47.453306 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c3af8588-3804-4c0b-82fe-b6eb8a1edfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:47.557509 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af8588-3804-4c0b-82fe-b6eb8a1edfb3 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:47.565099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def39292-31f4-48a2-ab78-f3b2b69f2b3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:47.567095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def39292-31f4-48a2-ab78-f3b2b69f2b3f service swift] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:47.567507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def39292-31f4-48a2-ab78-f3b2b69f2b3f service swift] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:47.567874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def39292-31f4-48a2-ab78-f3b2b69f2b3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:47.580134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def39292-31f4-48a2-ab78-f3b2b69f2b3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:47.583374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def39292-31f4-48a2-ab78-f3b2b69f2b3f service swift] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:47.595762 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1201/2375] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:03:48.472914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea562baf-7db3-4dd4-9393-e0c600995f85 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:48.472914 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ea562baf-7db3-4dd4-9393-e0c600995f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:48.497973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea562baf-7db3-4dd4-9393-e0c600995f85 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:48.512830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:48.513576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:48.513879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:48.514252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] PATH_INFO: `/v3/projects/cf2fe11cd4b24e45a20f7cb4a8fe6922` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:48.521977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2fe11cd4b24e45a20f7cb4a8fe6922)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:48.524430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:48.699563 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2fe11cd4b24e45a20f7cb4a8fe6922', 'request_id': 'req-a0b2b662-1c83-4d2a-9c21-d98f994b7527'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.872165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2fe11cd4b24e45a20f7cb4a8fe6922', 'request_id': 'req-a0b2b662-1c83-4d2a-9c21-d98f994b7527'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.882627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2fe11cd4b24e45a20f7cb4a8fe6922', 'request_id': 'req-a0b2b662-1c83-4d2a-9c21-d98f994b7527'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.898220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] The token cache is being invalidate because project cf2fe11cd4b24e45a20f7cb4a8fe6922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:48.898557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.899779 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.909819 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1175/2376] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:48 2022] DELETE /identity/v3/projects/cf2fe11cd4b24e45a20f7cb4a8fe6922 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:48.909994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def39292-31f4-48a2-ab78-f3b2b69f2b3f service swift] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:48.925744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def39292-31f4-48a2-ab78-f3b2b69f2b3f service swift] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.034372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.035060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.035364 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.035784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] PATH_INFO: `/v3/users/020286d3d5414ce69bf0eaa8323b17e1` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.038272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020286d3d5414ce69bf0eaa8323b17e1)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.045644 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.327986 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020286d3d5414ce69bf0eaa8323b17e1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:49.331562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:49.349517 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020286d3d5414ce69bf0eaa8323b17e1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:49.470512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020286d3d5414ce69bf0eaa8323b17e1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:49.472647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020286d3d5414ce69bf0eaa8323b17e1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:49.474875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b99d3214-25de-4494-829d-1280375ed649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020286d3d5414ce69bf0eaa8323b17e1'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:49.529183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1202/2377] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:48 2022] DELETE /identity/v3/users/020286d3d5414ce69bf0eaa8323b17e1 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:49.682687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.685184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:49.709586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2b662-1c83-4d2a-9c21-d98f994b7527 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.744574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:49.799747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.800834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.801286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.801726 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] PATH_INFO: `/v3/users/c91b7021353a4a6c9535a2f0d832234e` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.803733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91b7021353a4a6c9535a2f0d832234e)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.806224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:50.048169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91b7021353a4a6c9535a2f0d832234e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:50.076575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91b7021353a4a6c9535a2f0d832234e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:50.169997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91b7021353a4a6c9535a2f0d832234e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:50.172213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91b7021353a4a6c9535a2f0d832234e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:50.191552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91b7021353a4a6c9535a2f0d832234e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:50.204038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1176/2378] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:49 2022] DELETE /identity/v3/users/c91b7021353a4a6c9535a2f0d832234e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:50.209730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a832d-830d-48cc-a64d-f87c6335ff97 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.210723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a832d-830d-48cc-a64d-f87c6335ff97 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.210723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a832d-830d-48cc-a64d-f87c6335ff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.231655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:50.233606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:50.265658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-884a832d-830d-48cc-a64d-f87c6335ff97 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:50.268557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-884a832d-830d-48cc-a64d-f87c6335ff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:50.352836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c394c5-05e6-40cf-8e65-5c37de8f1778 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:50.362748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:50.364576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.365308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.366028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] PATH_INFO: `/v3/projects/76b743bdf8674697b518903809d533f2` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.368448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b743bdf8674697b518903809d533f2)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:50.376133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:50.383464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1203/2379] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:50.394550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a832d-830d-48cc-a64d-f87c6335ff97 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:50.396202 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-884a832d-830d-48cc-a64d-f87c6335ff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:50.471067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a832d-830d-48cc-a64d-f87c6335ff97 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:50.477317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df187e1-98b2-4177-8581-56611fb75233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:50.478409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df187e1-98b2-4177-8581-56611fb75233 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.478927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df187e1-98b2-4177-8581-56611fb75233 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.479448 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df187e1-98b2-4177-8581-56611fb75233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.504292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df187e1-98b2-4177-8581-56611fb75233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:50.507086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df187e1-98b2-4177-8581-56611fb75233 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:50.517815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:50.520249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b743bdf8674697b518903809d533f2', 'request_id': 'req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:50.528666 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1204/2380] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:50.569612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b743bdf8674697b518903809d533f2', 'request_id': 'req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:50.597270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b743bdf8674697b518903809d533f2', 'request_id': 'req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:50.640972 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] The token cache is being invalidate because project 76b743bdf8674697b518903809d533f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:50.641704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:50.644462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c5e24ea3-1915-44b1-8f9d-4345b88b9b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:50.650172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1177/2381] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:50 2022] DELETE /identity/v3/projects/76b743bdf8674697b518903809d533f2 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:50.658913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cda8c-3bd9-43e3-8481-f7d156661a74 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.659477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cda8c-3bd9-43e3-8481-f7d156661a74 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.659932 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cda8c-3bd9-43e3-8481-f7d156661a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.725840 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-312cda8c-3bd9-43e3-8481-f7d156661a74 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:50.729044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-312cda8c-3bd9-43e3-8481-f7d156661a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:50.863954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1205/2382] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:50.876400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f5f5-263e-41fc-a6a4-707f604c2e14 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.878207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f5f5-263e-41fc-a6a4-707f604c2e14 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.878978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f5f5-263e-41fc-a6a4-707f604c2e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.912280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d8a4f5f5-263e-41fc-a6a4-707f604c2e14 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:50.914227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d8a4f5f5-263e-41fc-a6a4-707f604c2e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:50.948716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1178/2383] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:50.949837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cda8c-3bd9-43e3-8481-f7d156661a74 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:50.960962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cda8c-3bd9-43e3-8481-f7d156661a74 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:50.967331 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db82d-617b-442f-a94b-16a7127defd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:50.967964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db82d-617b-442f-a94b-16a7127defd7 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.968247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db82d-617b-442f-a94b-16a7127defd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.968583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db82d-617b-442f-a94b-16a7127defd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.969269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db82d-617b-442f-a94b-16a7127defd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:50.969581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db82d-617b-442f-a94b-16a7127defd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:50.971205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db82d-617b-442f-a94b-16a7127defd7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:50.976215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:50.991861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1206/2384] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:03:50.993250 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4f5f5-263e-41fc-a6a4-707f604c2e14 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.015544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4f5f5-263e-41fc-a6a4-707f604c2e14 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.022511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ae9f9-a2e8-4263-a647-328db9700627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.023260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ae9f9-a2e8-4263-a647-328db9700627 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.023606 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ae9f9-a2e8-4263-a647-328db9700627 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.023884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ae9f9-a2e8-4263-a647-328db9700627 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.025048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ae9f9-a2e8-4263-a647-328db9700627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.026985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ae9f9-a2e8-4263-a647-328db9700627 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.131039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1179/2385] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:50 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:51.133104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db82d-617b-442f-a94b-16a7127defd7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.168769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db82d-617b-442f-a94b-16a7127defd7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.323055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bbc76-9f1c-40d2-a2bf-f84774748876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.324170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bbc76-9f1c-40d2-a2bf-f84774748876 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.324170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bbc76-9f1c-40d2-a2bf-f84774748876 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.324846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bbc76-9f1c-40d2-a2bf-f84774748876 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.325604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bbc76-9f1c-40d2-a2bf-f84774748876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.327788 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bbc76-9f1c-40d2-a2bf-f84774748876 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.520642 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1207/2386] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:51 2022] POST /identity/v3/users => generated 284 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:51.522762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ae9f9-a2e8-4263-a647-328db9700627 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.547199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ae9f9-a2e8-4263-a647-328db9700627 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.556811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf3d68-d225-4dd8-8677-c057b5721ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.558075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf3d68-d225-4dd8-8677-c057b5721ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.558897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf3d68-d225-4dd8-8677-c057b5721ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.559743 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf3d68-d225-4dd8-8677-c057b5721ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.561120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf3d68-d225-4dd8-8677-c057b5721ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.563306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf3d68-d225-4dd8-8677-c057b5721ee7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.591492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1180/2387] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:51.591600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bbc76-9f1c-40d2-a2bf-f84774748876 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.606246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bbc76-9f1c-40d2-a2bf-f84774748876 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.620088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49cee3-e6ea-408c-b8e4-e42705f4e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.620756 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49cee3-e6ea-408c-b8e4-e42705f4e8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.621038 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49cee3-e6ea-408c-b8e4-e42705f4e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.621481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49cee3-e6ea-408c-b8e4-e42705f4e8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.622114 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49cee3-e6ea-408c-b8e4-e42705f4e8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.624699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49cee3-e6ea-408c-b8e4-e42705f4e8a8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.627826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf3d68-d225-4dd8-8677-c057b5721ee7 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.629950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-97bf3d68-d225-4dd8-8677-c057b5721ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:51.649134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf3d68-d225-4dd8-8677-c057b5721ee7 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.657979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.658707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.659168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.660951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] PATH_INFO: `/v3/projects/769ace9c3ba34fbfa402b7326fb339dc` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.662493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769ace9c3ba34fbfa402b7326fb339dc)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.667803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1208/2388] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:51.667990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.668726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49cee3-e6ea-408c-b8e4-e42705f4e8a8 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.683618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49cee3-e6ea-408c-b8e4-e42705f4e8a8 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.702438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8c03-b498-4918-a5b0-90cc57d76ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.702438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8c03-b498-4918-a5b0-90cc57d76ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.702438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8c03-b498-4918-a5b0-90cc57d76ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.702438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8c03-b498-4918-a5b0-90cc57d76ae5 admin admin] PATH_INFO: `/v3/projects/988c55c0c47a44cf8441c164998aaf36/users/cb1461276dc845329dfae1cecec8f89e/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.723825 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8c03-b498-4918-a5b0-90cc57d76ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988c55c0c47a44cf8441c164998aaf36, user_id=cb1461276dc845329dfae1cecec8f89e, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.729844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8c03-b498-4918-a5b0-90cc57d76ae5 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.803776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1209/2389] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:51 2022] PUT /identity/v3/projects/988c55c0c47a44cf8441c164998aaf36/users/cb1461276dc845329dfae1cecec8f89e/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:51.813802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8c03-b498-4918-a5b0-90cc57d76ae5 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.815571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-523d8c03-b498-4918-a5b0-90cc57d76ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:51.817607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769ace9c3ba34fbfa402b7326fb339dc', 'request_id': 'req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:51.876286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8c03-b498-4918-a5b0-90cc57d76ae5 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.928176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337579a-daf6-46bf-8b77-3525509fffcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.929538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337579a-daf6-46bf-8b77-3525509fffcf service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.930030 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337579a-daf6-46bf-8b77-3525509fffcf service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.930376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337579a-daf6-46bf-8b77-3525509fffcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.932732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d337579a-daf6-46bf-8b77-3525509fffcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:51.934241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769ace9c3ba34fbfa402b7326fb339dc', 'request_id': 'req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:51.944368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769ace9c3ba34fbfa402b7326fb339dc', 'request_id': 'req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:51.959544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] The token cache is being invalidate because project 769ace9c3ba34fbfa402b7326fb339dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:51.959983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:51.961026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-78bfdd1e-adbb-4e71-b90d-b56b7167bf63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:51.961469 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:51.963471 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1181/2390] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:51 2022] DELETE /identity/v3/projects/769ace9c3ba34fbfa402b7326fb339dc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:51.965644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cb91c-5ca7-4196-b5d7-5a36b933fde1 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.966357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cb91c-5ca7-4196-b5d7-5a36b933fde1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.967042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cb91c-5ca7-4196-b5d7-5a36b933fde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.016873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a80cb91c-5ca7-4196-b5d7-5a36b933fde1 None None] MFA Rules not processed for user `cb1461276dc845329dfae1cecec8f89e`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:52.017408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337579a-daf6-46bf-8b77-3525509fffcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:52.018563 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a80cb91c-5ca7-4196-b5d7-5a36b933fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:52.018863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337579a-daf6-46bf-8b77-3525509fffcf service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:52.029894 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1210/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:52.031057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337579a-daf6-46bf-8b77-3525509fffcf service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:52.110302 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1182/2392] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:52.115307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337579a-daf6-46bf-8b77-3525509fffcf service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:52.116569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cb91c-5ca7-4196-b5d7-5a36b933fde1 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:52.118727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a80cb91c-5ca7-4196-b5d7-5a36b933fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:52.122151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:52.122876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.123156 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.123427 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] PATH_INFO: `/v3/users/215860a0011b4439bbc2c81eabe7609a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.125152 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=215860a0011b4439bbc2c81eabe7609a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:52.127134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:52.135850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cb91c-5ca7-4196-b5d7-5a36b933fde1 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:52.141689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56675db-88f5-417b-b67e-f476e5fd857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:52.142317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56675db-88f5-417b-b67e-f476e5fd857c admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.142598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56675db-88f5-417b-b67e-f476e5fd857c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.142867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56675db-88f5-417b-b67e-f476e5fd857c admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.143504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56675db-88f5-417b-b67e-f476e5fd857c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:52.145602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56675db-88f5-417b-b67e-f476e5fd857c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:52.150521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:52.258465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1183/2393] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:52 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:52.262808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56675db-88f5-417b-b67e-f476e5fd857c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:52.355818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56675db-88f5-417b-b67e-f476e5fd857c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:52.363257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66437891-8f5b-434b-abfb-a4d6c4a6dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:52.364005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437891-8f5b-434b-abfb-a4d6c4a6dd64 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.364406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437891-8f5b-434b-abfb-a4d6c4a6dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.364798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437891-8f5b-434b-abfb-a4d6c4a6dd64 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.366663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66437891-8f5b-434b-abfb-a4d6c4a6dd64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:52.368730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215860a0011b4439bbc2c81eabe7609a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:52.371043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66437891-8f5b-434b-abfb-a4d6c4a6dd64 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:52.387671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215860a0011b4439bbc2c81eabe7609a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:52.470935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1184/2394] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:52 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:52.472079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66437891-8f5b-434b-abfb-a4d6c4a6dd64 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:52.472985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215860a0011b4439bbc2c81eabe7609a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:52.475451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215860a0011b4439bbc2c81eabe7609a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:52.477659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215860a0011b4439bbc2c81eabe7609a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:52.492638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66437891-8f5b-434b-abfb-a4d6c4a6dd64 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:52.507582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846560d-ffb2-453c-958e-be2edb5a2c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:52.509674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846560d-ffb2-453c-958e-be2edb5a2c33 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.509674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846560d-ffb2-453c-958e-be2edb5a2c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.509674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846560d-ffb2-453c-958e-be2edb5a2c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.512565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846560d-ffb2-453c-958e-be2edb5a2c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:52.513849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846560d-ffb2-453c-958e-be2edb5a2c33 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:52.535413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1185/2395] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:52.540564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1211/2396] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:52 2022] DELETE /identity/v3/users/215860a0011b4439bbc2c81eabe7609a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:52.540784 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846560d-ffb2-453c-958e-be2edb5a2c33 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:52.544936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2846560d-ffb2-453c-958e-be2edb5a2c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:52.570591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846560d-ffb2-453c-958e-be2edb5a2c33 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:52.676854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b3576-dace-4568-89b9-c6d9df16fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:52.677667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3576-dace-4568-89b9-c6d9df16fda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.678757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3576-dace-4568-89b9-c6d9df16fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.679169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3576-dace-4568-89b9-c6d9df16fda3 admin admin] PATH_INFO: `/v3/projects/d28ab5ed89e94d2d9c9f0e7c90229394/users/712e45d64ec14f27a70c6dcd78c40f6c/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.707044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b3576-dace-4568-89b9-c6d9df16fda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28ab5ed89e94d2d9c9f0e7c90229394, user_id=712e45d64ec14f27a70c6dcd78c40f6c, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:52.710498 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b3576-dace-4568-89b9-c6d9df16fda3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:52.829513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1186/2397] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:52 2022] PUT /identity/v3/projects/d28ab5ed89e94d2d9c9f0e7c90229394/users/712e45d64ec14f27a70c6dcd78c40f6c/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:52.833471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:52.849166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edfad8-aae5-45c9-9b86-2e1709c937aa admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:52.933054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:52.986553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3200a5-826b-4033-aafa-a696689ad607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:52.990307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3200a5-826b-4033-aafa-a696689ad607 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.990307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3200a5-826b-4033-aafa-a696689ad607 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.990307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3200a5-826b-4033-aafa-a696689ad607 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.990307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3200a5-826b-4033-aafa-a696689ad607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:52.992015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3200a5-826b-4033-aafa-a696689ad607 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.007450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1212/2398] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:53.011782 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b3576-dace-4568-89b9-c6d9df16fda3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.027632 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b3576-dace-4568-89b9-c6d9df16fda3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.037823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb21bd-01ed-403f-93b7-f2c83ac184d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.038968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb21bd-01ed-403f-93b7-f2c83ac184d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.039419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb21bd-01ed-403f-93b7-f2c83ac184d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.039797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb21bd-01ed-403f-93b7-f2c83ac184d5 admin admin] PATH_INFO: `/v3/projects/d28ab5ed89e94d2d9c9f0e7c90229394/users/712e45d64ec14f27a70c6dcd78c40f6c/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.042562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb21bd-01ed-403f-93b7-f2c83ac184d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28ab5ed89e94d2d9c9f0e7c90229394, user_id=712e45d64ec14f27a70c6dcd78c40f6c, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.047055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb21bd-01ed-403f-93b7-f2c83ac184d5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.069124 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1187/2399] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:53 2022] PUT /identity/v3/projects/d28ab5ed89e94d2d9c9f0e7c90229394/users/712e45d64ec14f27a70c6dcd78c40f6c/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:53.086437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569dc7f-d2f4-452f-a32d-527947f9cd00 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.086755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569dc7f-d2f4-452f-a32d-527947f9cd00 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.087037 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569dc7f-d2f4-452f-a32d-527947f9cd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.123121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-1569dc7f-d2f4-452f-a32d-527947f9cd00 None None] MFA Rules not processed for user `712e45d64ec14f27a70c6dcd78c40f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:53.125189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1569dc7f-d2f4-452f-a32d-527947f9cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:53.228683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1213/2400] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:53.236828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb21bd-01ed-403f-93b7-f2c83ac184d5 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.238709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-edeb21bd-01ed-403f-93b7-f2c83ac184d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:53.277887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569dc7f-d2f4-452f-a32d-527947f9cd00 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.282066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1569dc7f-d2f4-452f-a32d-527947f9cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:53.323867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:53.368557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb21bd-01ed-403f-93b7-f2c83ac184d5 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.374256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569dc7f-d2f4-452f-a32d-527947f9cd00 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.376675 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f67cb1-c0e3-492d-a55c-5d7f8703d031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.377999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f67cb1-c0e3-492d-a55c-5d7f8703d031 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.378565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f67cb1-c0e3-492d-a55c-5d7f8703d031 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.379013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f67cb1-c0e3-492d-a55c-5d7f8703d031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.379646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.380442 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.380617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.380964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] PATH_INFO: `/v3/projects/1fcfb13b67fb4dd5bdd5c38a8d141893` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.382109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fcfb13b67fb4dd5bdd5c38a8d141893)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.384088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.397458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f67cb1-c0e3-492d-a55c-5d7f8703d031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.403867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f67cb1-c0e3-492d-a55c-5d7f8703d031 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.417767 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1188/2401] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:53.490643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fcfb13b67fb4dd5bdd5c38a8d141893', 'request_id': 'req-5e9893cd-5bf9-419f-9487-eef653719fb7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:53.498176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fcfb13b67fb4dd5bdd5c38a8d141893', 'request_id': 'req-5e9893cd-5bf9-419f-9487-eef653719fb7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:53.500803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:53.506793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fcfb13b67fb4dd5bdd5c38a8d141893', 'request_id': 'req-5e9893cd-5bf9-419f-9487-eef653719fb7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:53.568293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f67cb1-c0e3-492d-a55c-5d7f8703d031 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.570814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d9f67cb1-c0e3-492d-a55c-5d7f8703d031 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:53.585506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f67cb1-c0e3-492d-a55c-5d7f8703d031 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.595727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] The token cache is being invalidate because project 1fcfb13b67fb4dd5bdd5c38a8d141893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:53.597316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:53.599346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5e9893cd-5bf9-419f-9487-eef653719fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:53.603748 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1214/2402] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:53 2022] DELETE /identity/v3/projects/1fcfb13b67fb4dd5bdd5c38a8d141893 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:53.624114 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79755b-9200-49f0-bbd3-dcd268f96e5b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.624700 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79755b-9200-49f0-bbd3-dcd268f96e5b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.625139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79755b-9200-49f0-bbd3-dcd268f96e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.648297 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3c79755b-9200-49f0-bbd3-dcd268f96e5b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:53.650396 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3c79755b-9200-49f0-bbd3-dcd268f96e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:53.663229 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229ab6-c037-48a5-ac54-8ad968ddfb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.664812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229ab6-c037-48a5-ac54-8ad968ddfb25 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.665888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229ab6-c037-48a5-ac54-8ad968ddfb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.666515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229ab6-c037-48a5-ac54-8ad968ddfb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.670645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-16229ab6-c037-48a5-ac54-8ad968ddfb25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:53.745265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1215/2403] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:53.753888 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea780-9fc8-40af-9e4e-42f6665d43fd None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.754331 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea780-9fc8-40af-9e4e-42f6665d43fd None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.754607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea780-9fc8-40af-9e4e-42f6665d43fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.791122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16229ab6-c037-48a5-ac54-8ad968ddfb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.794696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16229ab6-c037-48a5-ac54-8ad968ddfb25 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.804735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-f8dea780-9fc8-40af-9e4e-42f6665d43fd None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:53.810276 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f8dea780-9fc8-40af-9e4e-42f6665d43fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:53.810613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1189/2404] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:53.832344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1216/2405] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:53.834520 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229ab6-c037-48a5-ac54-8ad968ddfb25 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.859159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229ab6-c037-48a5-ac54-8ad968ddfb25 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.869375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f78942-4a90-4096-88ca-768186756275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.870356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f78942-4a90-4096-88ca-768186756275 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.870821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f78942-4a90-4096-88ca-768186756275 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.871660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f78942-4a90-4096-88ca-768186756275 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.874655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f78942-4a90-4096-88ca-768186756275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:53.874982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f78942-4a90-4096-88ca-768186756275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.878052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f78942-4a90-4096-88ca-768186756275 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.903552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1190/2406] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:03:53.909625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea780-9fc8-40af-9e4e-42f6665d43fd None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.924566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea780-9fc8-40af-9e4e-42f6665d43fd None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.936617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b049a0-5681-4203-a181-3481a3bac6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.937955 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b049a0-5681-4203-a181-3481a3bac6be admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.943655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b049a0-5681-4203-a181-3481a3bac6be admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.943655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b049a0-5681-4203-a181-3481a3bac6be admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.943655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b049a0-5681-4203-a181-3481a3bac6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.944447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b049a0-5681-4203-a181-3481a3bac6be admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:54.065056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1217/2407] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:53 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:54.070419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f78942-4a90-4096-88ca-768186756275 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:54.090818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f78942-4a90-4096-88ca-768186756275 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:54.167770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e8b37-c574-42b7-8b55-2d3f1fef211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:54.168448 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8b37-c574-42b7-8b55-2d3f1fef211c admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.168836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8b37-c574-42b7-8b55-2d3f1fef211c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.169309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8b37-c574-42b7-8b55-2d3f1fef211c admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.170065 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e8b37-c574-42b7-8b55-2d3f1fef211c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:54.172661 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e8b37-c574-42b7-8b55-2d3f1fef211c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:54.311418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1191/2408] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:54 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:54.316613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b049a0-5681-4203-a181-3481a3bac6be admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:54.329800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b049a0-5681-4203-a181-3481a3bac6be admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:54.334587 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dc1fc-6d96-40e0-8f81-f792761a6d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:54.335312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc1fc-6d96-40e0-8f81-f792761a6d01 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.335593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc1fc-6d96-40e0-8f81-f792761a6d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.335865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc1fc-6d96-40e0-8f81-f792761a6d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.336621 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dc1fc-6d96-40e0-8f81-f792761a6d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:54.338294 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dc1fc-6d96-40e0-8f81-f792761a6d01 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:54.351465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1218/2409] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:54.355652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e8b37-c574-42b7-8b55-2d3f1fef211c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:54.395082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e8b37-c574-42b7-8b55-2d3f1fef211c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:54.401298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f31be7-8e78-451b-875e-b4d292f10f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:54.402328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f31be7-8e78-451b-875e-b4d292f10f69 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.402924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f31be7-8e78-451b-875e-b4d292f10f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.403407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f31be7-8e78-451b-875e-b4d292f10f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.404306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f31be7-8e78-451b-875e-b4d292f10f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:54.407402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f31be7-8e78-451b-875e-b4d292f10f69 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:54.410008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:54.427444 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dc1fc-6d96-40e0-8f81-f792761a6d01 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:54.428130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1192/2410] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:54.441412 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dc1fc-6d96-40e0-8f81-f792761a6d01 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:54.446352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe5c41-6069-4665-a4b9-b833215a9e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:54.447568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5c41-6069-4665-a4b9-b833215a9e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.447856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5c41-6069-4665-a4b9-b833215a9e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.448129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5c41-6069-4665-a4b9-b833215a9e6e admin admin] PATH_INFO: `/v3/projects/70f09b2221df4300923be2732f3c37ce/users/555848c3c2fe430d903091d887eb0478/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.470343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe5c41-6069-4665-a4b9-b833215a9e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f09b2221df4300923be2732f3c37ce, user_id=555848c3c2fe430d903091d887eb0478, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:54.473325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe5c41-6069-4665-a4b9-b833215a9e6e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:54.554954 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1219/2411] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:54 2022] PUT /identity/v3/projects/70f09b2221df4300923be2732f3c37ce/users/555848c3c2fe430d903091d887eb0478/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:54.590089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee558-79ff-48ea-95c6-c84820afb5ee None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.591992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee558-79ff-48ea-95c6-c84820afb5ee None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.592977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ee558-79ff-48ea-95c6-c84820afb5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.651202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-411ee558-79ff-48ea-95c6-c84820afb5ee None None] MFA Rules not processed for user `555848c3c2fe430d903091d887eb0478`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:54.652798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-411ee558-79ff-48ea-95c6-c84820afb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:54.792918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1193/2412] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:54.796488 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe5c41-6069-4665-a4b9-b833215a9e6e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:54.914138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe5c41-6069-4665-a4b9-b833215a9e6e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:54.924240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b8b8-14cf-4c77-8326-d379edf1db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:54.924240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b8b8-14cf-4c77-8326-d379edf1db7d admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.924898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b8b8-14cf-4c77-8326-d379edf1db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.925226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b8b8-14cf-4c77-8326-d379edf1db7d admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.926489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72b8b8-14cf-4c77-8326-d379edf1db7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:54.930519 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72b8b8-14cf-4c77-8326-d379edf1db7d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:55.030543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1220/2413] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:54 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:55.034172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ee558-79ff-48ea-95c6-c84820afb5ee None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:55.057665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ee558-79ff-48ea-95c6-c84820afb5ee None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:55.217217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef2f37-ee0a-4686-a08d-870b631b2bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:55.218282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef2f37-ee0a-4686-a08d-870b631b2bef admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:55.218565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef2f37-ee0a-4686-a08d-870b631b2bef admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:55.218762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef2f37-ee0a-4686-a08d-870b631b2bef admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:55.219429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef2f37-ee0a-4686-a08d-870b631b2bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:55.222029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef2f37-ee0a-4686-a08d-870b631b2bef admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:55.357679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1194/2414] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:55 2022] POST /identity/v3/users => generated 294 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:55.370947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b8b8-14cf-4c77-8326-d379edf1db7d admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:55.391631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b8b8-14cf-4c77-8326-d379edf1db7d admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:55.399190 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d5e3-9fb9-456b-9deb-f0ca128ef049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:55.399838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d5e3-9fb9-456b-9deb-f0ca128ef049 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:55.400232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d5e3-9fb9-456b-9deb-f0ca128ef049 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:55.400720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d5e3-9fb9-456b-9deb-f0ca128ef049 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:55.401493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005d5e3-9fb9-456b-9deb-f0ca128ef049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:55.403141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005d5e3-9fb9-456b-9deb-f0ca128ef049 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:55.405913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:55.417244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1221/2415] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:55.422097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef2f37-ee0a-4686-a08d-870b631b2bef admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:55.434067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef2f37-ee0a-4686-a08d-870b631b2bef admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:55.443289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1822a3-0660-493d-89fc-42c0608a645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:55.444617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1822a3-0660-493d-89fc-42c0608a645d admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:55.445061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1822a3-0660-493d-89fc-42c0608a645d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:55.445572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1822a3-0660-493d-89fc-42c0608a645d admin admin] PATH_INFO: `/v3/projects/a3c91645333c402eba214b82b1b8164d/users/2aec02e6f4304856abb4adffca0900fb/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:55.467423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1822a3-0660-493d-89fc-42c0608a645d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c91645333c402eba214b82b1b8164d, user_id=2aec02e6f4304856abb4adffca0900fb, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:55.472796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1822a3-0660-493d-89fc-42c0608a645d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:55.551384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1195/2416] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:55 2022] PUT /identity/v3/projects/a3c91645333c402eba214b82b1b8164d/users/2aec02e6f4304856abb4adffca0900fb/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:55.555205 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d5e3-9fb9-456b-9deb-f0ca128ef049 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:55.579653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d5e3-9fb9-456b-9deb-f0ca128ef049 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:55.682446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01210312-299c-4c1d-a491-8f19b3b5f6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:55.683087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210312-299c-4c1d-a491-8f19b3b5f6bd admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:55.683371 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210312-299c-4c1d-a491-8f19b3b5f6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:55.683651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210312-299c-4c1d-a491-8f19b3b5f6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:55.684310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01210312-299c-4c1d-a491-8f19b3b5f6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:55.688892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01210312-299c-4c1d-a491-8f19b3b5f6bd admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:55.704133 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1222/2417] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:55.708166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1822a3-0660-493d-89fc-42c0608a645d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:55.721850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1822a3-0660-493d-89fc-42c0608a645d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:55.736026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58d20d-d37a-4fd7-ab60-aac90e3e283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:55.737119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d20d-d37a-4fd7-ab60-aac90e3e283d admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:55.737523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d20d-d37a-4fd7-ab60-aac90e3e283d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:55.738181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d20d-d37a-4fd7-ab60-aac90e3e283d admin admin] PATH_INFO: `/v3/projects/a3c91645333c402eba214b82b1b8164d/users/2aec02e6f4304856abb4adffca0900fb/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:55.741689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58d20d-d37a-4fd7-ab60-aac90e3e283d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c91645333c402eba214b82b1b8164d, user_id=2aec02e6f4304856abb4adffca0900fb, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:55.754793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58d20d-d37a-4fd7-ab60-aac90e3e283d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:55.800400 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1196/2418] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:55 2022] PUT /identity/v3/projects/a3c91645333c402eba214b82b1b8164d/users/2aec02e6f4304856abb4adffca0900fb/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:55.813363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b2c95-bb26-427d-9417-7c02e301c6e7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:55.814219 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b2c95-bb26-427d-9417-7c02e301c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:55.814745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b2c95-bb26-427d-9417-7c02e301c6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:55.888098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0a0b2c95-bb26-427d-9417-7c02e301c6e7 None None] MFA Rules not processed for user `2aec02e6f4304856abb4adffca0900fb`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:55.890163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0a0b2c95-bb26-427d-9417-7c02e301c6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:56.025283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1223/2419] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:03:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:56.049389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58d20d-d37a-4fd7-ab60-aac90e3e283d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:56.051793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2b58d20d-d37a-4fd7-ab60-aac90e3e283d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:56.119793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:56.151294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58d20d-d37a-4fd7-ab60-aac90e3e283d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:56.158650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926b9b-070d-4c87-8df8-c5f3294b9dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:56.159751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926b9b-070d-4c87-8df8-c5f3294b9dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:56.160363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926b9b-070d-4c87-8df8-c5f3294b9dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:56.165642 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926b9b-070d-4c87-8df8-c5f3294b9dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:56.256381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926b9b-070d-4c87-8df8-c5f3294b9dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:56.257938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926b9b-070d-4c87-8df8-c5f3294b9dd2 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:56.277325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1197/2420] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:58.891247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b2c95-bb26-427d-9417-7c02e301c6e7 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:58.893018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0a0b2c95-bb26-427d-9417-7c02e301c6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:58.986702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b2c95-bb26-427d-9417-7c02e301c6e7 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:58.992409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c6b2e-db67-4025-8cc8-6518e0705b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:58.993626 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c6b2e-db67-4025-8cc8-6518e0705b52 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:58.993964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c6b2e-db67-4025-8cc8-6518e0705b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:58.994244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c6b2e-db67-4025-8cc8-6518e0705b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:58.996425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c45c6b2e-db67-4025-8cc8-6518e0705b52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:59.045012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:59.082532 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c6b2e-db67-4025-8cc8-6518e0705b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:59.084080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c6b2e-db67-4025-8cc8-6518e0705b52 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:59.094877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1224/2421] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:59.952288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926b9b-070d-4c87-8df8-c5f3294b9dd2 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:59.956180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-21926b9b-070d-4c87-8df8-c5f3294b9dd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:59.975675 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926b9b-070d-4c87-8df8-c5f3294b9dd2 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:59.983337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:59.984009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:59.984405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:59.984590 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] PATH_INFO: `/v3/users/cb1461276dc845329dfae1cecec8f89e` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:59.985818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1461276dc845329dfae1cecec8f89e)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:59.987787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:00.127977 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c6b2e-db67-4025-8cc8-6518e0705b52 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:00.142802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c6b2e-db67-4025-8cc8-6518e0705b52 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:00.159563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16890d6b-744d-4221-8dc3-125d3e0a15a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:00.159563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890d6b-744d-4221-8dc3-125d3e0a15a2 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.159563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890d6b-744d-4221-8dc3-125d3e0a15a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.161264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16890d6b-744d-4221-8dc3-125d3e0a15a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.184859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16890d6b-744d-4221-8dc3-125d3e0a15a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:00.187280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16890d6b-744d-4221-8dc3-125d3e0a15a2 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:00.201764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1225/2422] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:00.320691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1461276dc845329dfae1cecec8f89e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.373383 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1461276dc845329dfae1cecec8f89e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.495185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1461276dc845329dfae1cecec8f89e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.495999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1461276dc845329dfae1cecec8f89e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.507660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1461276dc845329dfae1cecec8f89e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.523288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1198/2423] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:59 2022] DELETE /identity/v3/users/cb1461276dc845329dfae1cecec8f89e => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:00.528346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80c812-a103-4109-898b-f5be1572aafb None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.528662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80c812-a103-4109-898b-f5be1572aafb None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.528934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80c812-a103-4109-898b-f5be1572aafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.549824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-8a80c812-a103-4109-898b-f5be1572aafb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:00.551146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8a80c812-a103-4109-898b-f5be1572aafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:00.638354 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1226/2424] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:00.654031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:00.656886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:00.755822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94e957-63b8-4e32-8ae6-37e6cdb9f18e admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:00.763145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4f53e-452b-4194-b39b-40a474966420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:00.763145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f53e-452b-4194-b39b-40a474966420 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.763145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f53e-452b-4194-b39b-40a474966420 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.763145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4f53e-452b-4194-b39b-40a474966420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.774385 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4f53e-452b-4194-b39b-40a474966420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:00.776753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4f53e-452b-4194-b39b-40a474966420 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:00.789733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1199/2425] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:01.868649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80c812-a103-4109-898b-f5be1572aafb None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:01.870388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8a80c812-a103-4109-898b-f5be1572aafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:01.884670 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80c812-a103-4109-898b-f5be1572aafb None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:01.902904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:01.903786 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:01.903953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:01.904118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] PATH_INFO: `/v3/projects/988c55c0c47a44cf8441c164998aaf36` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:01.906029 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=988c55c0c47a44cf8441c164998aaf36)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:01.908374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:02.033196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988c55c0c47a44cf8441c164998aaf36', 'request_id': 'req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.039893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988c55c0c47a44cf8441c164998aaf36', 'request_id': 'req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.047304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988c55c0c47a44cf8441c164998aaf36', 'request_id': 'req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.117877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] The token cache is being invalidate because project 988c55c0c47a44cf8441c164998aaf36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:02.118161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.118833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.120551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1227/2426] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:01 2022] DELETE /identity/v3/projects/988c55c0c47a44cf8441c164998aaf36 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:02.126881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4f53e-452b-4194-b39b-40a474966420 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:02.158196 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4f53e-452b-4194-b39b-40a474966420 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:02.162873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:02.252444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:02.253526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:02.254108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:02.254633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] PATH_INFO: `/v3/users/712e45d64ec14f27a70c6dcd78c40f6c` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:02.258185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712e45d64ec14f27a70c6dcd78c40f6c)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:02.262331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:02.583210 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712e45d64ec14f27a70c6dcd78c40f6c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.596658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712e45d64ec14f27a70c6dcd78c40f6c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.665435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712e45d64ec14f27a70c6dcd78c40f6c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.666195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712e45d64ec14f27a70c6dcd78c40f6c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.676217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-eb7d9771-ad93-4b55-8beb-464632f09538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712e45d64ec14f27a70c6dcd78c40f6c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.683285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1200/2427] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:02 2022] DELETE /identity/v3/users/712e45d64ec14f27a70c6dcd78c40f6c => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:03.258030 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:03.259219 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:03.290392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9658c-6c6c-4285-8a71-dcd0ddbed731 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:03.333374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:03.352864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:03.353542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.353823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.354101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] PATH_INFO: `/v3/projects/d28ab5ed89e94d2d9c9f0e7c90229394` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.357658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28ab5ed89e94d2d9c9f0e7c90229394)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:03.357658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:03.450689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28ab5ed89e94d2d9c9f0e7c90229394', 'request_id': 'req-18581c7b-f66a-4517-9e94-4996ba4af6bf'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.456766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28ab5ed89e94d2d9c9f0e7c90229394', 'request_id': 'req-18581c7b-f66a-4517-9e94-4996ba4af6bf'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.464014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28ab5ed89e94d2d9c9f0e7c90229394', 'request_id': 'req-18581c7b-f66a-4517-9e94-4996ba4af6bf'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.539636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] The token cache is being invalidate because project d28ab5ed89e94d2d9c9f0e7c90229394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:03.539812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.540598 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-18581c7b-f66a-4517-9e94-4996ba4af6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.542107 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1228/2428] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:03 2022] DELETE /identity/v3/projects/d28ab5ed89e94d2d9c9f0e7c90229394 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:03.547697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cb284-eedc-4b12-acd9-de7a86f180bb None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.548158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cb284-eedc-4b12-acd9-de7a86f180bb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.548394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cb284-eedc-4b12-acd9-de7a86f180bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.572950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b51cb284-eedc-4b12-acd9-de7a86f180bb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:03.573869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b51cb284-eedc-4b12-acd9-de7a86f180bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:03.648880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1201/2429] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:03.657714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152a1aa-b206-41e0-b809-90c4075d1768 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.658004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152a1aa-b206-41e0-b809-90c4075d1768 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.658280 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152a1aa-b206-41e0-b809-90c4075d1768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.678600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d152a1aa-b206-41e0-b809-90c4075d1768 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:03.679746 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d152a1aa-b206-41e0-b809-90c4075d1768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:03.688241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1229/2430] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:03.692717 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cb284-eedc-4b12-acd9-de7a86f180bb None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:03.705505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cb284-eedc-4b12-acd9-de7a86f180bb None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:03.707337 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152a1aa-b206-41e0-b809-90c4075d1768 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:03.708880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d152a1aa-b206-41e0-b809-90c4075d1768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:03.710860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108a8f2-b877-493e-b5cf-3515a8259a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:03.711474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108a8f2-b877-493e-b5cf-3515a8259a10 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.711751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108a8f2-b877-493e-b5cf-3515a8259a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.712048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108a8f2-b877-493e-b5cf-3515a8259a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.712709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108a8f2-b877-493e-b5cf-3515a8259a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:03.713011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108a8f2-b877-493e-b5cf-3515a8259a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:03.714608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108a8f2-b877-493e-b5cf-3515a8259a10 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:03.722725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152a1aa-b206-41e0-b809-90c4075d1768 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:03.727550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:03.728353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.728709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.728986 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] PATH_INFO: `/v3/users/1e513898018544c7924d592c40f7dd54` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.730151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e513898018544c7924d592c40f7dd54)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:03.732241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:03.735048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1202/2431] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:04:03.741581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108a8f2-b877-493e-b5cf-3515a8259a10 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:03.752591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108a8f2-b877-493e-b5cf-3515a8259a10 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:03.757979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de573547-97cc-4be1-ae1b-c590c2f837a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:03.758681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573547-97cc-4be1-ae1b-c590c2f837a8 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.759096 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573547-97cc-4be1-ae1b-c590c2f837a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.759376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573547-97cc-4be1-ae1b-c590c2f837a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.760011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de573547-97cc-4be1-ae1b-c590c2f837a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:03.762263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de573547-97cc-4be1-ae1b-c590c2f837a8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:03.775836 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:03.893348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1203/2432] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:03 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:03.894308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de573547-97cc-4be1-ae1b-c590c2f837a8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:03.954210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e513898018544c7924d592c40f7dd54'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.959832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de573547-97cc-4be1-ae1b-c590c2f837a8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:03.962450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e513898018544c7924d592c40f7dd54'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.970664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc98fd-5b7a-4da8-b43d-da05fe7bbf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:03.971291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc98fd-5b7a-4da8-b43d-da05fe7bbf2a admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.971571 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc98fd-5b7a-4da8-b43d-da05fe7bbf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.971846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc98fd-5b7a-4da8-b43d-da05fe7bbf2a admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.972478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc98fd-5b7a-4da8-b43d-da05fe7bbf2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:03.976907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc98fd-5b7a-4da8-b43d-da05fe7bbf2a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.048172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e513898018544c7924d592c40f7dd54'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:04.048896 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e513898018544c7924d592c40f7dd54'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:04.049590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e513898018544c7924d592c40f7dd54'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:04.064790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1204/2433] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:03 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:04.068903 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc98fd-5b7a-4da8-b43d-da05fe7bbf2a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.071293 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1230/2434] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:03 2022] DELETE /identity/v3/users/1e513898018544c7924d592c40f7dd54 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:04.071809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a0bc98fd-5b7a-4da8-b43d-da05fe7bbf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:04.086571 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc98fd-5b7a-4da8-b43d-da05fe7bbf2a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.159680 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f362fc6-cbc7-48da-860a-7eada4af3a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.160631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362fc6-cbc7-48da-860a-7eada4af3a2d admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.160631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362fc6-cbc7-48da-860a-7eada4af3a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.160631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362fc6-cbc7-48da-860a-7eada4af3a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.161326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f362fc6-cbc7-48da-860a-7eada4af3a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.163150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f362fc6-cbc7-48da-860a-7eada4af3a2d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.174305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1205/2435] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:04.178421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.190852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b5da8-a3ca-444d-a0a5-28549e05933a admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.197210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321cfa7-0763-437a-857c-689bea50a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.197862 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321cfa7-0763-437a-857c-689bea50a887 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.198165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321cfa7-0763-437a-857c-689bea50a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.198408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321cfa7-0763-437a-857c-689bea50a887 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.199055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321cfa7-0763-437a-857c-689bea50a887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.200716 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321cfa7-0763-437a-857c-689bea50a887 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.212178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1231/2436] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:04.216867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f362fc6-cbc7-48da-860a-7eada4af3a2d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.231569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f362fc6-cbc7-48da-860a-7eada4af3a2d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.239474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9694c6-da15-41de-85d0-e09ed8fe1191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.240164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9694c6-da15-41de-85d0-e09ed8fe1191 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.240446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9694c6-da15-41de-85d0-e09ed8fe1191 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.240794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9694c6-da15-41de-85d0-e09ed8fe1191 admin admin] PATH_INFO: `/v3/projects/e33dcb7b65d5469486b3715409ebf4c2/users/e45a460205a04e93a8db9690b1519c6b/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.262099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9694c6-da15-41de-85d0-e09ed8fe1191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33dcb7b65d5469486b3715409ebf4c2, user_id=e45a460205a04e93a8db9690b1519c6b, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.265973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9694c6-da15-41de-85d0-e09ed8fe1191 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.312500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1206/2437] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:04 2022] PUT /identity/v3/projects/e33dcb7b65d5469486b3715409ebf4c2/users/e45a460205a04e93a8db9690b1519c6b/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:04.324928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9550-1a8e-45e2-b81f-eaad82edfd5d None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.325508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9550-1a8e-45e2-b81f-eaad82edfd5d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.325508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f9550-1a8e-45e2-b81f-eaad82edfd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.358398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-302f9550-1a8e-45e2-b81f-eaad82edfd5d None None] MFA Rules not processed for user `e45a460205a04e93a8db9690b1519c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:04.359640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-302f9550-1a8e-45e2-b81f-eaad82edfd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:04.371921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:04.398621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9694c6-da15-41de-85d0-e09ed8fe1191 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.400423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bc9694c6-da15-41de-85d0-e09ed8fe1191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:04.449853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1232/2438] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:04.454712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9550-1a8e-45e2-b81f-eaad82edfd5d None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.473926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:04.489444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9694c6-da15-41de-85d0-e09ed8fe1191 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.494500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.495170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.495499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.495933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] PATH_INFO: `/v3/projects/94d81929179f482a81f4d8ab175aba9e` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.499266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d81929179f482a81f4d8ab175aba9e)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.499721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.530550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f9550-1a8e-45e2-b81f-eaad82edfd5d None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.535499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3230e86-1e02-47a4-bed2-92c7bb1002ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.536120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3230e86-1e02-47a4-bed2-92c7bb1002ec admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.536483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3230e86-1e02-47a4-bed2-92c7bb1002ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.536777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3230e86-1e02-47a4-bed2-92c7bb1002ec admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.537406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3230e86-1e02-47a4-bed2-92c7bb1002ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.539662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3230e86-1e02-47a4-bed2-92c7bb1002ec admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.609090 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d81929179f482a81f4d8ab175aba9e', 'request_id': 'req-07c627c7-7c55-427f-abc6-d4e0125a09e5'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:04.621079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1233/2439] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:04 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:04.626240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3230e86-1e02-47a4-bed2-92c7bb1002ec admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.687959 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d81929179f482a81f4d8ab175aba9e', 'request_id': 'req-07c627c7-7c55-427f-abc6-d4e0125a09e5'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:04.694806 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d81929179f482a81f4d8ab175aba9e', 'request_id': 'req-07c627c7-7c55-427f-abc6-d4e0125a09e5'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:04.701191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3230e86-1e02-47a4-bed2-92c7bb1002ec admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.706142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e130cc-d997-414d-aa32-882208be30f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.706552 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] The token cache is being invalidate because project 94d81929179f482a81f4d8ab175aba9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:04.706767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e130cc-d997-414d-aa32-882208be30f4 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.706883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:04.707052 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e130cc-d997-414d-aa32-882208be30f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.707460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e130cc-d997-414d-aa32-882208be30f4 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.707557 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-07c627c7-7c55-427f-abc6-d4e0125a09e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:04.708142 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e130cc-d997-414d-aa32-882208be30f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.709119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1207/2440] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:04 2022] DELETE /identity/v3/projects/94d81929179f482a81f4d8ab175aba9e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:04.713764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e130cc-d997-414d-aa32-882208be30f4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.714131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb598-41e6-4828-bf36-b5541498cf7d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.714412 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb598-41e6-4828-bf36-b5541498cf7d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.714726 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb598-41e6-4828-bf36-b5541498cf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.736091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7b7cb598-41e6-4828-bf36-b5541498cf7d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:04.737380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7b7cb598-41e6-4828-bf36-b5541498cf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:04.745875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1208/2441] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:04.754063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a32e1-63c2-4f17-bda2-dc52259cfeb6 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.754316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a32e1-63c2-4f17-bda2-dc52259cfeb6 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.755377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a32e1-63c2-4f17-bda2-dc52259cfeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.775323 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-be1a32e1-63c2-4f17-bda2-dc52259cfeb6 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:04.776576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-be1a32e1-63c2-4f17-bda2-dc52259cfeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:04.785582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1209/2442] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:04.791164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a32e1-63c2-4f17-bda2-dc52259cfeb6 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.800035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a32e1-63c2-4f17-bda2-dc52259cfeb6 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.804978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc05373-e876-4168-9f0e-6a39bdc4a940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.805576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc05373-e876-4168-9f0e-6a39bdc4a940 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.805858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc05373-e876-4168-9f0e-6a39bdc4a940 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.806130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc05373-e876-4168-9f0e-6a39bdc4a940 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.806792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc05373-e876-4168-9f0e-6a39bdc4a940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:04.807091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc05373-e876-4168-9f0e-6a39bdc4a940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.808720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc05373-e876-4168-9f0e-6a39bdc4a940 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.820596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1234/2443] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:04 2022] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:04.826370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1210/2444] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:04:04.826551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e130cc-d997-414d-aa32-882208be30f4 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.826662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc05373-e876-4168-9f0e-6a39bdc4a940 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.826776 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e6e130cc-d997-414d-aa32-882208be30f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:04.835277 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc05373-e876-4168-9f0e-6a39bdc4a940 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.839958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e130cc-d997-414d-aa32-882208be30f4 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.840147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74077d17-82b3-49b0-a7b3-c5452985bb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.840807 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74077d17-82b3-49b0-a7b3-c5452985bb8a admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.840938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74077d17-82b3-49b0-a7b3-c5452985bb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.841690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74077d17-82b3-49b0-a7b3-c5452985bb8a admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.842478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74077d17-82b3-49b0-a7b3-c5452985bb8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.844345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74077d17-82b3-49b0-a7b3-c5452985bb8a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.845567 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2e7d8-222b-45b1-b5a4-a2a96c5b6ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.846184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2e7d8-222b-45b1-b5a4-a2a96c5b6ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.846782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2e7d8-222b-45b1-b5a4-a2a96c5b6ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.847102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2e7d8-222b-45b1-b5a4-a2a96c5b6ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.847755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2e7d8-222b-45b1-b5a4-a2a96c5b6ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.849383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2e7d8-222b-45b1-b5a4-a2a96c5b6ef6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.864324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1235/2445] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:04.865395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2e7d8-222b-45b1-b5a4-a2a96c5b6ef6 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.875940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2e7d8-222b-45b1-b5a4-a2a96c5b6ef6 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.880537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305a4cf-620b-4ad8-9faa-5aebc66428e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.881251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305a4cf-620b-4ad8-9faa-5aebc66428e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.881524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305a4cf-620b-4ad8-9faa-5aebc66428e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.881801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305a4cf-620b-4ad8-9faa-5aebc66428e3 admin admin] PATH_INFO: `/v3/projects/257116f6391340c684b5d9ce415cffe6/users/ff28cf4268bd48b4881aafd2f3bdaf5a/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.896761 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305a4cf-620b-4ad8-9faa-5aebc66428e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257116f6391340c684b5d9ce415cffe6, user_id=ff28cf4268bd48b4881aafd2f3bdaf5a, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.899511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305a4cf-620b-4ad8-9faa-5aebc66428e3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.901765 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:04.918036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1211/2446] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:04 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:04.922791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74077d17-82b3-49b0-a7b3-c5452985bb8a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.975061 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1236/2447] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:04 2022] PUT /identity/v3/projects/257116f6391340c684b5d9ce415cffe6/users/ff28cf4268bd48b4881aafd2f3bdaf5a/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:04.979214 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305a4cf-620b-4ad8-9faa-5aebc66428e3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.991008 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74077d17-82b3-49b0-a7b3-c5452985bb8a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.039333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:05.053072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305a4cf-620b-4ad8-9faa-5aebc66428e3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.058426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4a5ba-634f-467f-a1c6-615c0e6f8e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.059402 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4a5ba-634f-467f-a1c6-615c0e6f8e01 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.060020 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4a5ba-634f-467f-a1c6-615c0e6f8e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.060431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4a5ba-634f-467f-a1c6-615c0e6f8e01 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.061296 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4a5ba-634f-467f-a1c6-615c0e6f8e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.062999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65aae7-71ba-4422-8b9c-91655bd5d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.063156 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4a5ba-634f-467f-a1c6-615c0e6f8e01 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.064421 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65aae7-71ba-4422-8b9c-91655bd5d3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.064883 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65aae7-71ba-4422-8b9c-91655bd5d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.065345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65aae7-71ba-4422-8b9c-91655bd5d3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.066204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65aae7-71ba-4422-8b9c-91655bd5d3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.069022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65aae7-71ba-4422-8b9c-91655bd5d3f3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.081584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1237/2448] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:05.086540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65aae7-71ba-4422-8b9c-91655bd5d3f3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.098815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65aae7-71ba-4422-8b9c-91655bd5d3f3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.104828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61437b26-7fa0-47d6-ad00-4540cac83156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.105607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437b26-7fa0-47d6-ad00-4540cac83156 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.105887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437b26-7fa0-47d6-ad00-4540cac83156 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.106177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437b26-7fa0-47d6-ad00-4540cac83156 admin admin] PATH_INFO: `/v3/projects/257116f6391340c684b5d9ce415cffe6/users/ff28cf4268bd48b4881aafd2f3bdaf5a/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.109215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61437b26-7fa0-47d6-ad00-4540cac83156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257116f6391340c684b5d9ce415cffe6, user_id=ff28cf4268bd48b4881aafd2f3bdaf5a, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.112114 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61437b26-7fa0-47d6-ad00-4540cac83156 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.112957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1212/2449] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:04 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:05.117867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4a5ba-634f-467f-a1c6-615c0e6f8e01 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.124588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1238/2450] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:05 2022] PUT /identity/v3/projects/257116f6391340c684b5d9ce415cffe6/users/ff28cf4268bd48b4881aafd2f3bdaf5a/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:05.129601 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4a5ba-634f-467f-a1c6-615c0e6f8e01 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.141617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c665f-1f12-47e6-99ce-c2ef88c102e3 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.141890 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c665f-1f12-47e6-99ce-c2ef88c102e3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.142166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c665f-1f12-47e6-99ce-c2ef88c102e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.183054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-969c665f-1f12-47e6-99ce-c2ef88c102e3 None None] MFA Rules not processed for user `ff28cf4268bd48b4881aafd2f3bdaf5a`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:05.184381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-969c665f-1f12-47e6-99ce-c2ef88c102e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:05.202704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2667f65-aad4-46f6-828e-0239696ccc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.203336 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2667f65-aad4-46f6-828e-0239696ccc64 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.203662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2667f65-aad4-46f6-828e-0239696ccc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.204074 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2667f65-aad4-46f6-828e-0239696ccc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.204840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2667f65-aad4-46f6-828e-0239696ccc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.210271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2667f65-aad4-46f6-828e-0239696ccc64 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.220381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1213/2451] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:05.224853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2667f65-aad4-46f6-828e-0239696ccc64 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.238847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2667f65-aad4-46f6-828e-0239696ccc64 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.244979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7f32e-b409-4e97-8c10-7c38d31db27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.245599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7f32e-b409-4e97-8c10-7c38d31db27b admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.245868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7f32e-b409-4e97-8c10-7c38d31db27b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.246354 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7f32e-b409-4e97-8c10-7c38d31db27b admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.246982 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7f32e-b409-4e97-8c10-7c38d31db27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.248644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7f32e-b409-4e97-8c10-7c38d31db27b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.260559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1214/2452] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:05.264868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7f32e-b409-4e97-8c10-7c38d31db27b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.275082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7f32e-b409-4e97-8c10-7c38d31db27b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.275468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1239/2453] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:05.284664 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93220339-6acc-4452-bbac-97de514fbd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.285549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93220339-6acc-4452-bbac-97de514fbd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.285691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93220339-6acc-4452-bbac-97de514fbd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.286118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93220339-6acc-4452-bbac-97de514fbd9a admin admin] PATH_INFO: `/v3/projects/5fc0cce6d565404c8e03476dd8e853d9/users/e82b8e490db4462599ae537d8b8d8ea3/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.290534 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c665f-1f12-47e6-99ce-c2ef88c102e3 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.292032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-969c665f-1f12-47e6-99ce-c2ef88c102e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:05.302704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93220339-6acc-4452-bbac-97de514fbd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc0cce6d565404c8e03476dd8e853d9, user_id=e82b8e490db4462599ae537d8b8d8ea3, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.305488 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93220339-6acc-4452-bbac-97de514fbd9a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.375360 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c665f-1f12-47e6-99ce-c2ef88c102e3 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.379260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753dfd5-3ca2-4d9a-a103-7d6f45d69838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.379777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753dfd5-3ca2-4d9a-a103-7d6f45d69838 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.380054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753dfd5-3ca2-4d9a-a103-7d6f45d69838 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.380328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753dfd5-3ca2-4d9a-a103-7d6f45d69838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.394499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1215/2454] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:05 2022] PUT /identity/v3/projects/5fc0cce6d565404c8e03476dd8e853d9/users/e82b8e490db4462599ae537d8b8d8ea3/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:05.398096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753dfd5-3ca2-4d9a-a103-7d6f45d69838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.399899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753dfd5-3ca2-4d9a-a103-7d6f45d69838 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.408317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c112b6-dda5-4a7c-9e82-680dff1bf956 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.409203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c112b6-dda5-4a7c-9e82-680dff1bf956 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.410876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c112b6-dda5-4a7c-9e82-680dff1bf956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.413254 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1240/2455] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:05.448502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-d0c112b6-dda5-4a7c-9e82-680dff1bf956 None None] MFA Rules not processed for user `e82b8e490db4462599ae537d8b8d8ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:05.449449 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d0c112b6-dda5-4a7c-9e82-680dff1bf956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:05.461531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753dfd5-3ca2-4d9a-a103-7d6f45d69838 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.468827 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:05.474497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753dfd5-3ca2-4d9a-a103-7d6f45d69838 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.551249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1216/2456] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:05.562194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.563025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.563307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.563587 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] PATH_INFO: `/v3/users/e45a460205a04e93a8db9690b1519c6b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.565722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45a460205a04e93a8db9690b1519c6b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.565865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c112b6-dda5-4a7c-9e82-680dff1bf956 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.567856 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d0c112b6-dda5-4a7c-9e82-680dff1bf956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:05.568390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.609491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:05.677416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c112b6-dda5-4a7c-9e82-680dff1bf956 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.683521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44727c-108d-4013-ab69-fdabfc9c3c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.686817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44727c-108d-4013-ab69-fdabfc9c3c70 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.686817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44727c-108d-4013-ab69-fdabfc9c3c70 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.686817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44727c-108d-4013-ab69-fdabfc9c3c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.694581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44727c-108d-4013-ab69-fdabfc9c3c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.696192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44727c-108d-4013-ab69-fdabfc9c3c70 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.711303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1217/2457] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:05.869738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45a460205a04e93a8db9690b1519c6b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:05.878965 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45a460205a04e93a8db9690b1519c6b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.048031 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45a460205a04e93a8db9690b1519c6b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.048891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45a460205a04e93a8db9690b1519c6b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.049533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45a460205a04e93a8db9690b1519c6b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.074379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1241/2458] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:05 2022] DELETE /identity/v3/users/e45a460205a04e93a8db9690b1519c6b => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:06.079182 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a72a64-eaaf-4b86-b837-6fa875a0c095 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:06.079467 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a72a64-eaaf-4b86-b837-6fa875a0c095 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:06.079742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a72a64-eaaf-4b86-b837-6fa875a0c095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:06.098628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-81a72a64-eaaf-4b86-b837-6fa875a0c095 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:06.099843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-81a72a64-eaaf-4b86-b837-6fa875a0c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:06.162665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1218/2459] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:06.174559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:06.176035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:06.242387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a995104-91b3-4711-a781-343660d1b989 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:06.246117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f976669-f15c-4eaa-ac74-892d482d23d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:06.246735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f976669-f15c-4eaa-ac74-892d482d23d7 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:06.247013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f976669-f15c-4eaa-ac74-892d482d23d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:06.247285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f976669-f15c-4eaa-ac74-892d482d23d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:06.257734 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f976669-f15c-4eaa-ac74-892d482d23d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:06.259191 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f976669-f15c-4eaa-ac74-892d482d23d7 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:06.269472 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1242/2460] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:06.719919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a72a64-eaaf-4b86-b837-6fa875a0c095 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:06.721514 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-81a72a64-eaaf-4b86-b837-6fa875a0c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:06.734080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a72a64-eaaf-4b86-b837-6fa875a0c095 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:06.739091 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:06.740201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:06.740707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:06.741000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] PATH_INFO: `/v3/projects/e33dcb7b65d5469486b3715409ebf4c2` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:06.742194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33dcb7b65d5469486b3715409ebf4c2)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:06.744651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:06.873698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33dcb7b65d5469486b3715409ebf4c2', 'request_id': 'req-e4db0855-e2e4-4961-af15-50cab8812762'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.927876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33dcb7b65d5469486b3715409ebf4c2', 'request_id': 'req-e4db0855-e2e4-4961-af15-50cab8812762'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.935108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33dcb7b65d5469486b3715409ebf4c2', 'request_id': 'req-e4db0855-e2e4-4961-af15-50cab8812762'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.945866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] The token cache is being invalidate because project e33dcb7b65d5469486b3715409ebf4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:06.946156 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.946828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.948355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1219/2461] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:06 2022] DELETE /identity/v3/projects/e33dcb7b65d5469486b3715409ebf4c2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:06.953028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f976669-f15c-4eaa-ac74-892d482d23d7 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:06.966281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f976669-f15c-4eaa-ac74-892d482d23d7 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:07.009386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:07.046912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:07.047703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:07.048076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:07.048488 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] PATH_INFO: `/v3/users/ff28cf4268bd48b4881aafd2f3bdaf5a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:07.049694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff28cf4268bd48b4881aafd2f3bdaf5a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:07.052534 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:07.262691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff28cf4268bd48b4881aafd2f3bdaf5a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:07.270399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff28cf4268bd48b4881aafd2f3bdaf5a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:07.333672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff28cf4268bd48b4881aafd2f3bdaf5a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:07.334296 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff28cf4268bd48b4881aafd2f3bdaf5a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:07.334934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5bf15d57-51fd-4d88-87b9-4d0bb142892f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff28cf4268bd48b4881aafd2f3bdaf5a'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:07.359116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1243/2462] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:06 2022] DELETE /identity/v3/users/ff28cf4268bd48b4881aafd2f3bdaf5a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:08.044596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:08.048865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:08.073060 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db0855-e2e4-4961-af15-50cab8812762 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:08.113827 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:08.141017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:08.143112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:08.143112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:08.143112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] PATH_INFO: `/v3/projects/257116f6391340c684b5d9ce415cffe6` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:08.143406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=257116f6391340c684b5d9ce415cffe6)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:08.145272 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:08.296038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257116f6391340c684b5d9ce415cffe6', 'request_id': 'req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:08.420001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257116f6391340c684b5d9ce415cffe6', 'request_id': 'req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:08.427013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257116f6391340c684b5d9ce415cffe6', 'request_id': 'req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:08.437981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] The token cache is being invalidate because project 257116f6391340c684b5d9ce415cffe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:08.438270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:08.438967 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-f832ced3-132a-4b00-b0b1-2ae4dd698e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:08.440568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1220/2463] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:08 2022] DELETE /identity/v3/projects/257116f6391340c684b5d9ce415cffe6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:08.445580 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b56a0-4c7f-403e-a80c-cc9a6d7d6854 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:08.446092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b56a0-4c7f-403e-a80c-cc9a6d7d6854 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:08.446210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b56a0-4c7f-403e-a80c-cc9a6d7d6854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:08.467482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e12b56a0-4c7f-403e-a80c-cc9a6d7d6854 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:08.468486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e12b56a0-4c7f-403e-a80c-cc9a6d7d6854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:08.530374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1244/2464] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:08.538269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebdbcc-f5ab-4132-b4d7-2e0676d4bc10 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:08.538558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebdbcc-f5ab-4132-b4d7-2e0676d4bc10 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:08.538837 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebdbcc-f5ab-4132-b4d7-2e0676d4bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:08.559484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-52ebdbcc-f5ab-4132-b4d7-2e0676d4bc10 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:08.561535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-52ebdbcc-f5ab-4132-b4d7-2e0676d4bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:08.569662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1221/2465] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:08.574289 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b56a0-4c7f-403e-a80c-cc9a6d7d6854 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:08.584933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b56a0-4c7f-403e-a80c-cc9a6d7d6854 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:08.590207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa29f-3945-46a7-a824-6c3701b56d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:08.590821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa29f-3945-46a7-a824-6c3701b56d8a admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:08.591100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa29f-3945-46a7-a824-6c3701b56d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:08.591375 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa29f-3945-46a7-a824-6c3701b56d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:08.592077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eaa29f-3945-46a7-a824-6c3701b56d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:08.592384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eaa29f-3945-46a7-a824-6c3701b56d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:08.594036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eaa29f-3945-46a7-a824-6c3701b56d8a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:08.606405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1245/2466] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:08.610947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebdbcc-f5ab-4132-b4d7-2e0676d4bc10 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:08.621291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebdbcc-f5ab-4132-b4d7-2e0676d4bc10 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:08.627072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c324f1-a112-4b5b-9e87-bf56558c2a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:08.627690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c324f1-a112-4b5b-9e87-bf56558c2a1b admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:08.627996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c324f1-a112-4b5b-9e87-bf56558c2a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:08.628267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c324f1-a112-4b5b-9e87-bf56558c2a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:08.628944 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c324f1-a112-4b5b-9e87-bf56558c2a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:08.630898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c324f1-a112-4b5b-9e87-bf56558c2a1b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:08.753473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1222/2467] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:08 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:08.765201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa29f-3945-46a7-a824-6c3701b56d8a admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:08.777577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa29f-3945-46a7-a824-6c3701b56d8a admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:08.812109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:08.839599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545813aa-3239-483d-bab6-85cb90e51909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:08.840278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545813aa-3239-483d-bab6-85cb90e51909 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:08.840582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545813aa-3239-483d-bab6-85cb90e51909 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:08.846398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545813aa-3239-483d-bab6-85cb90e51909 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:08.846398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545813aa-3239-483d-bab6-85cb90e51909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:08.846398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545813aa-3239-483d-bab6-85cb90e51909 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:08.941507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1246/2468] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:08 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:08.945492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c324f1-a112-4b5b-9e87-bf56558c2a1b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:08.955918 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c324f1-a112-4b5b-9e87-bf56558c2a1b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:08.960537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f659d-0c07-4b3e-826b-c921811cbba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:08.961150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f659d-0c07-4b3e-826b-c921811cbba5 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:08.961427 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f659d-0c07-4b3e-826b-c921811cbba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:08.961744 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f659d-0c07-4b3e-826b-c921811cbba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:08.962345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f659d-0c07-4b3e-826b-c921811cbba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:08.963951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f659d-0c07-4b3e-826b-c921811cbba5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:08.974886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1223/2469] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:08.981314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545813aa-3239-483d-bab6-85cb90e51909 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:08.992298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545813aa-3239-483d-bab6-85cb90e51909 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:08.997378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea4e2c-4b4f-4368-85f2-ca80cadd3233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:09.001498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4e2c-4b4f-4368-85f2-ca80cadd3233 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:09.001498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4e2c-4b4f-4368-85f2-ca80cadd3233 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:09.001498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4e2c-4b4f-4368-85f2-ca80cadd3233 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:09.001498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea4e2c-4b4f-4368-85f2-ca80cadd3233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:09.001923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea4e2c-4b4f-4368-85f2-ca80cadd3233 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:09.011769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1247/2470] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:09.015804 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f659d-0c07-4b3e-826b-c921811cbba5 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:09.025885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f659d-0c07-4b3e-826b-c921811cbba5 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:09.030653 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac970cc-1c18-419d-9859-b1af8711fb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:09.031331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac970cc-1c18-419d-9859-b1af8711fb45 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:09.031607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac970cc-1c18-419d-9859-b1af8711fb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:09.031905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac970cc-1c18-419d-9859-b1af8711fb45 admin admin] PATH_INFO: `/v3/projects/463140b7f64d43d0bb0408378a92fbac/users/c7c7920b7a3849089affbd45d3a6e4a9/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:09.047401 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac970cc-1c18-419d-9859-b1af8711fb45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463140b7f64d43d0bb0408378a92fbac, user_id=c7c7920b7a3849089affbd45d3a6e4a9, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:09.050249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac970cc-1c18-419d-9859-b1af8711fb45 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:09.099428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1224/2471] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:09 2022] PUT /identity/v3/projects/463140b7f64d43d0bb0408378a92fbac/users/c7c7920b7a3849089affbd45d3a6e4a9/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:09.111557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcb6d0-0e91-4fb1-a60b-50700589fabc None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:09.111880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcb6d0-0e91-4fb1-a60b-50700589fabc None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:09.112158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fcb6d0-0e91-4fb1-a60b-50700589fabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:09.140739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-f0fcb6d0-0e91-4fb1-a60b-50700589fabc None None] MFA Rules not processed for user `c7c7920b7a3849089affbd45d3a6e4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:09.141978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f0fcb6d0-0e91-4fb1-a60b-50700589fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:09.206959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1248/2472] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:09.211479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac970cc-1c18-419d-9859-b1af8711fb45 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:09.270849 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:09.274899 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac970cc-1c18-419d-9859-b1af8711fb45 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:09.280419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a1e90-1009-49c2-91b4-523c8dbd24a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:09.281063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1e90-1009-49c2-91b4-523c8dbd24a2 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:09.281339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1e90-1009-49c2-91b4-523c8dbd24a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:09.281605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1e90-1009-49c2-91b4-523c8dbd24a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:09.282255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a1e90-1009-49c2-91b4-523c8dbd24a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:09.284254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a1e90-1009-49c2-91b4-523c8dbd24a2 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:09.388600 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1225/2473] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:09 2022] POST /identity/v3/projects => generated 389 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:09.394875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcb6d0-0e91-4fb1-a60b-50700589fabc None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:09.407028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fcb6d0-0e91-4fb1-a60b-50700589fabc None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:09.477913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee871b-afea-4253-84fb-1cd3dd9ae891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:09.489828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee871b-afea-4253-84fb-1cd3dd9ae891 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:09.489828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee871b-afea-4253-84fb-1cd3dd9ae891 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:09.489828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee871b-afea-4253-84fb-1cd3dd9ae891 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:09.489828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee871b-afea-4253-84fb-1cd3dd9ae891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:09.489828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee871b-afea-4253-84fb-1cd3dd9ae891 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:09.548261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1249/2474] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:09 2022] POST /identity/v3/users => generated 301 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:09.552428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a1e90-1009-49c2-91b4-523c8dbd24a2 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:09.566016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a1e90-1009-49c2-91b4-523c8dbd24a2 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:09.571808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b692-e2ef-404c-b022-8edaa87af94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:09.572497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b692-e2ef-404c-b022-8edaa87af94a admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:09.572864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b692-e2ef-404c-b022-8edaa87af94a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:09.573134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b692-e2ef-404c-b022-8edaa87af94a admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:09.573779 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261b692-e2ef-404c-b022-8edaa87af94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:09.575378 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261b692-e2ef-404c-b022-8edaa87af94a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:09.589829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1226/2475] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:09.592993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee871b-afea-4253-84fb-1cd3dd9ae891 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:09.605399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee871b-afea-4253-84fb-1cd3dd9ae891 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:09.611064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc7b04-ff24-4553-ad46-2c14d3b866ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:09.611822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc7b04-ff24-4553-ad46-2c14d3b866ba admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:09.612234 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc7b04-ff24-4553-ad46-2c14d3b866ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:09.612671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc7b04-ff24-4553-ad46-2c14d3b866ba admin admin] PATH_INFO: `/v3/projects/bc8222364ae64bbf9f9120e4e81a05f4/users/2ee62c33b8b14cbb9825b02e02f2ec5e/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:09.629445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc7b04-ff24-4553-ad46-2c14d3b866ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8222364ae64bbf9f9120e4e81a05f4, user_id=2ee62c33b8b14cbb9825b02e02f2ec5e, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:09.632419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc7b04-ff24-4553-ad46-2c14d3b866ba admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:09.699775 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1250/2476] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:09 2022] PUT /identity/v3/projects/bc8222364ae64bbf9f9120e4e81a05f4/users/2ee62c33b8b14cbb9825b02e02f2ec5e/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:09.704366 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b692-e2ef-404c-b022-8edaa87af94a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:09.714709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b692-e2ef-404c-b022-8edaa87af94a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:09.775458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfe3e2-4c50-4ce9-aaf6-4ad37114eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:09.776003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfe3e2-4c50-4ce9-aaf6-4ad37114eb88 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:09.776285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfe3e2-4c50-4ce9-aaf6-4ad37114eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:09.776594 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfe3e2-4c50-4ce9-aaf6-4ad37114eb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:09.777267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfe3e2-4c50-4ce9-aaf6-4ad37114eb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:09.779022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfe3e2-4c50-4ce9-aaf6-4ad37114eb88 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:09.791409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1227/2477] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:09.796008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc7b04-ff24-4553-ad46-2c14d3b866ba admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:09.807773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc7b04-ff24-4553-ad46-2c14d3b866ba admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:09.813076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44924116-3c05-480c-949f-c870baf80bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:09.814122 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44924116-3c05-480c-949f-c870baf80bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:09.814440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44924116-3c05-480c-949f-c870baf80bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:09.814718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44924116-3c05-480c-949f-c870baf80bfd admin admin] PATH_INFO: `/v3/projects/bc8222364ae64bbf9f9120e4e81a05f4/users/2ee62c33b8b14cbb9825b02e02f2ec5e/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:09.816865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44924116-3c05-480c-949f-c870baf80bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8222364ae64bbf9f9120e4e81a05f4, user_id=2ee62c33b8b14cbb9825b02e02f2ec5e, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:09.819657 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44924116-3c05-480c-949f-c870baf80bfd admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:09.822292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:09.864730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1251/2478] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:09 2022] PUT /identity/v3/projects/bc8222364ae64bbf9f9120e4e81a05f4/users/2ee62c33b8b14cbb9825b02e02f2ec5e/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:09.874399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682cded-2e58-4ea8-bab3-b03ceb0892a7 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:09.874686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682cded-2e58-4ea8-bab3-b03ceb0892a7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:09.874960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682cded-2e58-4ea8-bab3-b03ceb0892a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:09.905150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-5682cded-2e58-4ea8-bab3-b03ceb0892a7 None None] MFA Rules not processed for user `2ee62c33b8b14cbb9825b02e02f2ec5e`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:09.906391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5682cded-2e58-4ea8-bab3-b03ceb0892a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:09.977431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1228/2479] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:09.988625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44924116-3c05-480c-949f-c870baf80bfd admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:09.990428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-44924116-3c05-480c-949f-c870baf80bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:10.055911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44924116-3c05-480c-949f-c870baf80bfd admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:10.059898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87bfd4-f7ff-4514-8ea4-ba5e378edad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:10.061041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87bfd4-f7ff-4514-8ea4-ba5e378edad7 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:10.068410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87bfd4-f7ff-4514-8ea4-ba5e378edad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:10.068410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87bfd4-f7ff-4514-8ea4-ba5e378edad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:10.071588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87bfd4-f7ff-4514-8ea4-ba5e378edad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:10.073085 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87bfd4-f7ff-4514-8ea4-ba5e378edad7 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:10.083677 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1252/2480] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:09 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:10.228144 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682cded-2e58-4ea8-bab3-b03ceb0892a7 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:10.283765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:10.294636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682cded-2e58-4ea8-bab3-b03ceb0892a7 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:10.299312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:10.299949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:10.300228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:10.300499 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] PATH_INFO: `/v3/users/c7c7920b7a3849089affbd45d3a6e4a9` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:10.301685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c7920b7a3849089affbd45d3a6e4a9)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:10.303603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:10.461851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c7920b7a3849089affbd45d3a6e4a9'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:10.474111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c7920b7a3849089affbd45d3a6e4a9'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:10.517353 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c7920b7a3849089affbd45d3a6e4a9'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:10.517993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c7920b7a3849089affbd45d3a6e4a9'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:10.526536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c7920b7a3849089affbd45d3a6e4a9'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:10.533339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1229/2481] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:10 2022] DELETE /identity/v3/users/c7c7920b7a3849089affbd45d3a6e4a9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:10.538298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966db14-3502-4ae2-b386-42764f6070e7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:10.538298 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966db14-3502-4ae2-b386-42764f6070e7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:10.539475 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966db14-3502-4ae2-b386-42764f6070e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:10.559527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-9966db14-3502-4ae2-b386-42764f6070e7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:10.561702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9966db14-3502-4ae2-b386-42764f6070e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:10.630920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1253/2482] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:10.641172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:10.642805 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:10.703951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426b20c-0d26-4de8-9ca4-e44ffb7c91eb admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:10.707669 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be13fa-9a00-4822-8e9e-6a3331fe5947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:10.708281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be13fa-9a00-4822-8e9e-6a3331fe5947 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:10.708584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be13fa-9a00-4822-8e9e-6a3331fe5947 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:10.708856 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be13fa-9a00-4822-8e9e-6a3331fe5947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:10.718838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be13fa-9a00-4822-8e9e-6a3331fe5947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:10.720327 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be13fa-9a00-4822-8e9e-6a3331fe5947 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:10.730699 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1230/2483] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:11.170313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966db14-3502-4ae2-b386-42764f6070e7 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:11.172164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9966db14-3502-4ae2-b386-42764f6070e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:11.199095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966db14-3502-4ae2-b386-42764f6070e7 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:11.205795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:11.206496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:11.206792 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:11.207061 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] PATH_INFO: `/v3/projects/463140b7f64d43d0bb0408378a92fbac` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:11.208199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=463140b7f64d43d0bb0408378a92fbac)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:11.210102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:11.361639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463140b7f64d43d0bb0408378a92fbac', 'request_id': 'req-c56abc40-24c9-45bb-a93d-da8bc068b397'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:11.368366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463140b7f64d43d0bb0408378a92fbac', 'request_id': 'req-c56abc40-24c9-45bb-a93d-da8bc068b397'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:11.375468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463140b7f64d43d0bb0408378a92fbac', 'request_id': 'req-c56abc40-24c9-45bb-a93d-da8bc068b397'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:11.505838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] The token cache is being invalidate because project 463140b7f64d43d0bb0408378a92fbac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:11.508118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:11.508118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:11.508430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1254/2484] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:11 2022] DELETE /identity/v3/projects/463140b7f64d43d0bb0408378a92fbac => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:11.513119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be13fa-9a00-4822-8e9e-6a3331fe5947 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:11.524231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be13fa-9a00-4822-8e9e-6a3331fe5947 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:11.587376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:11.588030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:11.588321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:11.588629 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] PATH_INFO: `/v3/users/2ee62c33b8b14cbb9825b02e02f2ec5e` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:11.589813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee62c33b8b14cbb9825b02e02f2ec5e)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:11.591852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:11.610107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:11.901384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee62c33b8b14cbb9825b02e02f2ec5e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:11.914374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee62c33b8b14cbb9825b02e02f2ec5e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.039946 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee62c33b8b14cbb9825b02e02f2ec5e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.041245 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:12.041908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee62c33b8b14cbb9825b02e02f2ec5e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.042027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:12.047355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3a75e4d2-9522-4a17-b128-02e61560f717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee62c33b8b14cbb9825b02e02f2ec5e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.053613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56abc40-24c9-45bb-a93d-da8bc068b397 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:12.054564 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1231/2485] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:11 2022] DELETE /identity/v3/users/2ee62c33b8b14cbb9825b02e02f2ec5e => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:12.073099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:12.116691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:12.117345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:12.117621 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:12.117893 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] PATH_INFO: `/v3/users/e82b8e490db4462599ae537d8b8d8ea3` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:12.119044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82b8e490db4462599ae537d8b8d8ea3)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:12.121072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:12.310027 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82b8e490db4462599ae537d8b8d8ea3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.318612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82b8e490db4462599ae537d8b8d8ea3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.424882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82b8e490db4462599ae537d8b8d8ea3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.425488 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82b8e490db4462599ae537d8b8d8ea3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.426066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82b8e490db4462599ae537d8b8d8ea3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.445287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1255/2486] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:12 2022] DELETE /identity/v3/users/e82b8e490db4462599ae537d8b8d8ea3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:12.449890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fd269-1ff5-49c4-bcb0-466677500ade None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:12.450178 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fd269-1ff5-49c4-bcb0-466677500ade None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:12.450457 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fd269-1ff5-49c4-bcb0-466677500ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:12.470093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-f54fd269-1ff5-49c4-bcb0-466677500ade None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:12.471305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f54fd269-1ff5-49c4-bcb0-466677500ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:12.494187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:12.496022 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:12.571132 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1232/2487] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:12.581372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fd269-1ff5-49c4-bcb0-466677500ade None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:12.583007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f54fd269-1ff5-49c4-bcb0-466677500ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:12.598715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae20b44-a37d-4c4a-8b2f-15d6519f7f00 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:12.603751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:12.608113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:12.608113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:12.608113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] PATH_INFO: `/v3/projects/bc8222364ae64bbf9f9120e4e81a05f4` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:12.608113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc8222364ae64bbf9f9120e4e81a05f4)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:12.608777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:12.648470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fd269-1ff5-49c4-bcb0-466677500ade None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:12.651282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f145dd-5bf2-4d32-8c8b-c5084800e346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:12.651897 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f145dd-5bf2-4d32-8c8b-c5084800e346 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:12.652239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f145dd-5bf2-4d32-8c8b-c5084800e346 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:12.652491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f145dd-5bf2-4d32-8c8b-c5084800e346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:12.663254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f145dd-5bf2-4d32-8c8b-c5084800e346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:12.664736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f145dd-5bf2-4d32-8c8b-c5084800e346 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:12.676368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1233/2488] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:12.707740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:12.714500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8222364ae64bbf9f9120e4e81a05f4', 'request_id': 'req-13f85dca-165e-463a-8009-4349fa176ca9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.721288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8222364ae64bbf9f9120e4e81a05f4', 'request_id': 'req-13f85dca-165e-463a-8009-4349fa176ca9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.728882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8222364ae64bbf9f9120e4e81a05f4', 'request_id': 'req-13f85dca-165e-463a-8009-4349fa176ca9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.798101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] The token cache is being invalidate because project bc8222364ae64bbf9f9120e4e81a05f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:12.799686 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.799686 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-13f85dca-165e-463a-8009-4349fa176ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:12.801318 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1256/2489] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:12 2022] DELETE /identity/v3/projects/bc8222364ae64bbf9f9120e4e81a05f4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:12.810758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd66d-a89b-4466-a55d-f1639342a337 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:12.810758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd66d-a89b-4466-a55d-f1639342a337 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:12.810758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd66d-a89b-4466-a55d-f1639342a337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:12.835543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8dbbd66d-a89b-4466-a55d-f1639342a337 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:12.836794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8dbbd66d-a89b-4466-a55d-f1639342a337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:12.876857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:12.917610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1234/2490] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:12.926582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ddf9-d84d-49e9-b2db-381abcca1332 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:12.926901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ddf9-d84d-49e9-b2db-381abcca1332 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:12.927182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ddf9-d84d-49e9-b2db-381abcca1332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:12.950834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c1a1ddf9-d84d-49e9-b2db-381abcca1332 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:12.952712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c1a1ddf9-d84d-49e9-b2db-381abcca1332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:12.967660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1257/2491] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:12.974612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbd66d-a89b-4466-a55d-f1639342a337 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:12.985582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbd66d-a89b-4466-a55d-f1639342a337 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:12.991000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510223-f9f1-4ad5-8bfb-a027640d7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:12.991724 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510223-f9f1-4ad5-8bfb-a027640d7d1d admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:12.992108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510223-f9f1-4ad5-8bfb-a027640d7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:12.992581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510223-f9f1-4ad5-8bfb-a027640d7d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:12.993525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88510223-f9f1-4ad5-8bfb-a027640d7d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:12.993952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88510223-f9f1-4ad5-8bfb-a027640d7d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:12.995859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88510223-f9f1-4ad5-8bfb-a027640d7d1d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.012685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1235/2492] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:13.018104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1ddf9-d84d-49e9-b2db-381abcca1332 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.029125 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1ddf9-d84d-49e9-b2db-381abcca1332 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.034019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d80ec5-41da-456a-99e9-86f05659e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.034667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d80ec5-41da-456a-99e9-86f05659e47a admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.035044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d80ec5-41da-456a-99e9-86f05659e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.035360 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d80ec5-41da-456a-99e9-86f05659e47a admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.035973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d80ec5-41da-456a-99e9-86f05659e47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.037921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d80ec5-41da-456a-99e9-86f05659e47a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.097445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510223-f9f1-4ad5-8bfb-a027640d7d1d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.099479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-88510223-f9f1-4ad5-8bfb-a027640d7d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:13.121871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88510223-f9f1-4ad5-8bfb-a027640d7d1d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.130217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.130217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.130217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.130217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] PATH_INFO: `/v3/projects/5fc0cce6d565404c8e03476dd8e853d9` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.131173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc0cce6d565404c8e03476dd8e853d9)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.133588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1258/2493] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:13.136729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.137489 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d80ec5-41da-456a-99e9-86f05659e47a admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.210901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d80ec5-41da-456a-99e9-86f05659e47a admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.215450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9188fba-fb0a-4c1a-ad20-e93e6359a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.219715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9188fba-fb0a-4c1a-ad20-e93e6359a3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.219715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9188fba-fb0a-4c1a-ad20-e93e6359a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.219715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9188fba-fb0a-4c1a-ad20-e93e6359a3f2 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.219715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9188fba-fb0a-4c1a-ad20-e93e6359a3f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.219715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9188fba-fb0a-4c1a-ad20-e93e6359a3f2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.255761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc0cce6d565404c8e03476dd8e853d9', 'request_id': 'req-e2b861ee-db67-4bcb-a243-530e8e4bba0a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:13.306128 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1259/2494] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:13.311083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9188fba-fb0a-4c1a-ad20-e93e6359a3f2 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.321235 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9188fba-fb0a-4c1a-ad20-e93e6359a3f2 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.328985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc0cce6d565404c8e03476dd8e853d9', 'request_id': 'req-e2b861ee-db67-4bcb-a243-530e8e4bba0a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:13.337182 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc0cce6d565404c8e03476dd8e853d9', 'request_id': 'req-e2b861ee-db67-4bcb-a243-530e8e4bba0a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:13.362882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] The token cache is being invalidate because project 5fc0cce6d565404c8e03476dd8e853d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:13.363464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:13.364727 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-e2b861ee-db67-4bcb-a243-530e8e4bba0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:13.368289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1236/2495] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:13 2022] DELETE /identity/v3/projects/5fc0cce6d565404c8e03476dd8e853d9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:13.372207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735fa2-0419-41b1-af16-86b9d30b1205 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.372492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735fa2-0419-41b1-af16-86b9d30b1205 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.372859 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735fa2-0419-41b1-af16-86b9d30b1205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.393067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c19b3f-8f3b-4db1-93fc-cf2df04942f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.394462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c19b3f-8f3b-4db1-93fc-cf2df04942f5 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.395139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c19b3f-8f3b-4db1-93fc-cf2df04942f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.395265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c19b3f-8f3b-4db1-93fc-cf2df04942f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.395647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-83735fa2-0419-41b1-af16-86b9d30b1205 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:13.396264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c19b3f-8f3b-4db1-93fc-cf2df04942f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.396943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-83735fa2-0419-41b1-af16-86b9d30b1205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:13.397750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c19b3f-8f3b-4db1-93fc-cf2df04942f5 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.405572 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1237/2496] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:13.408873 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1260/2497] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:13.412958 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735fa2-0419-41b1-af16-86b9d30b1205 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.414833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-83735fa2-0419-41b1-af16-86b9d30b1205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:13.415511 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0098886-57e0-404a-ada4-a634fb782ad4 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.415803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0098886-57e0-404a-ada4-a634fb782ad4 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.416143 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0098886-57e0-404a-ada4-a634fb782ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.427503 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735fa2-0419-41b1-af16-86b9d30b1205 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.432944 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304ef6a-485b-4982-81b9-f29c02855005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.433565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304ef6a-485b-4982-81b9-f29c02855005 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.433919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304ef6a-485b-4982-81b9-f29c02855005 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.434173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304ef6a-485b-4982-81b9-f29c02855005 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.435081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304ef6a-485b-4982-81b9-f29c02855005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.437651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304ef6a-485b-4982-81b9-f29c02855005 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.439377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c0098886-57e0-404a-ada4-a634fb782ad4 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:13.441062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c0098886-57e0-404a-ada4-a634fb782ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:13.449312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1261/2499] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:13.449511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1238/2499] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:13.454040 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304ef6a-485b-4982-81b9-f29c02855005 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.454200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0098886-57e0-404a-ada4-a634fb782ad4 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.465942 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304ef6a-485b-4982-81b9-f29c02855005 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.468158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0098886-57e0-404a-ada4-a634fb782ad4 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.470797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a07df-7089-4ca3-9adb-9cdf693e80ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.471405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a07df-7089-4ca3-9adb-9cdf693e80ae admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.471689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a07df-7089-4ca3-9adb-9cdf693e80ae admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.471962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a07df-7089-4ca3-9adb-9cdf693e80ae admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.472649 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a07df-7089-4ca3-9adb-9cdf693e80ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:13.472954 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a07df-7089-4ca3-9adb-9cdf693e80ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.473806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133c11e-aa00-4640-a34a-b7c12147976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.474614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a07df-7089-4ca3-9adb-9cdf693e80ae admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.474738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c11e-aa00-4640-a34a-b7c12147976c admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.474855 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c11e-aa00-4640-a34a-b7c12147976c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.475131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133c11e-aa00-4640-a34a-b7c12147976c admin admin] PATH_INFO: `/v3/projects/eb60fdb3301f4d2690197d2976fa9d33/users/08eddb6345304c88a5a6c27bd438f513/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.488311 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1239/2500] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:04:13.491738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133c11e-aa00-4640-a34a-b7c12147976c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb60fdb3301f4d2690197d2976fa9d33, user_id=08eddb6345304c88a5a6c27bd438f513, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.492617 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a07df-7089-4ca3-9adb-9cdf693e80ae admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.494616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133c11e-aa00-4640-a34a-b7c12147976c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.498523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:13.504077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a07df-7089-4ca3-9adb-9cdf693e80ae admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.508871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e274387-8f64-4991-83a2-96a813fd838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.509469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e274387-8f64-4991-83a2-96a813fd838a admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.509747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e274387-8f64-4991-83a2-96a813fd838a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.510020 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e274387-8f64-4991-83a2-96a813fd838a admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.510678 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e274387-8f64-4991-83a2-96a813fd838a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.512668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e274387-8f64-4991-83a2-96a813fd838a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.563585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1262/2501] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:13 2022] PUT /identity/v3/projects/eb60fdb3301f4d2690197d2976fa9d33/users/08eddb6345304c88a5a6c27bd438f513/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:13.574877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f43d9-750b-42cb-94e4-245cec4527e0 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.575164 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f43d9-750b-42cb-94e4-245cec4527e0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.575441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f43d9-750b-42cb-94e4-245cec4527e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.603509 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-363f43d9-750b-42cb-94e4-245cec4527e0 None None] MFA Rules not processed for user `08eddb6345304c88a5a6c27bd438f513`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:13.604752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-363f43d9-750b-42cb-94e4-245cec4527e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:13.628732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1240/2502] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:13.630673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e274387-8f64-4991-83a2-96a813fd838a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.679604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1263/2503] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:13.684375 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f43d9-750b-42cb-94e4-245cec4527e0 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.695786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:13.701171 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e274387-8f64-4991-83a2-96a813fd838a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.706322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671766d-9d30-479b-92ff-bca01067301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.706937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671766d-9d30-479b-92ff-bca01067301a admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.707217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671766d-9d30-479b-92ff-bca01067301a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.707489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671766d-9d30-479b-92ff-bca01067301a admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.708125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671766d-9d30-479b-92ff-bca01067301a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.710162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671766d-9d30-479b-92ff-bca01067301a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.750449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f43d9-750b-42cb-94e4-245cec4527e0 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.755137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ada17f-32e9-490f-b98a-97aa2926c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.755895 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ada17f-32e9-490f-b98a-97aa2926c3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.756172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ada17f-32e9-490f-b98a-97aa2926c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.756441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ada17f-32e9-490f-b98a-97aa2926c3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.757094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ada17f-32e9-490f-b98a-97aa2926c3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.759116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ada17f-32e9-490f-b98a-97aa2926c3e0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.819691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1241/2504] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:13.823755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671766d-9d30-479b-92ff-bca01067301a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.833764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671766d-9d30-479b-92ff-bca01067301a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.838568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfec6b-94b2-4cd4-8c12-388f22a1c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.839203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfec6b-94b2-4cd4-8c12-388f22a1c99e admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.839484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfec6b-94b2-4cd4-8c12-388f22a1c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.839748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfec6b-94b2-4cd4-8c12-388f22a1c99e admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.840394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfec6b-94b2-4cd4-8c12-388f22a1c99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.842540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfec6b-94b2-4cd4-8c12-388f22a1c99e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.853276 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1242/2505] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:13.857269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfec6b-94b2-4cd4-8c12-388f22a1c99e admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.867758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfec6b-94b2-4cd4-8c12-388f22a1c99e admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.872444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f59a7-2ddf-4cfc-9190-5c0e39910e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.876756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f59a7-2ddf-4cfc-9190-5c0e39910e74 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.876756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f59a7-2ddf-4cfc-9190-5c0e39910e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.876756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f59a7-2ddf-4cfc-9190-5c0e39910e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.876756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f59a7-2ddf-4cfc-9190-5c0e39910e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.876756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f59a7-2ddf-4cfc-9190-5c0e39910e74 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.885437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1243/2506] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:13.889790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f59a7-2ddf-4cfc-9190-5c0e39910e74 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.899668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f59a7-2ddf-4cfc-9190-5c0e39910e74 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.903386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1264/2507] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:13.910912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ada17f-32e9-490f-b98a-97aa2926c3e0 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.963011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37a33e-6078-4038-95a1-5d41e1ae8d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.963936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37a33e-6078-4038-95a1-5d41e1ae8d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.964399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37a33e-6078-4038-95a1-5d41e1ae8d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.964884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37a33e-6078-4038-95a1-5d41e1ae8d2b admin admin] PATH_INFO: `/v3/projects/6347f95a606f4836bc18d85e18f1b18e/users/655887220a0e4c41b6fc931c22264f22/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.969025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ada17f-32e9-490f-b98a-97aa2926c3e0 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.973719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54001bb0-a6c9-46ef-984e-96d8d49d5aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.974330 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54001bb0-a6c9-46ef-984e-96d8d49d5aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.974602 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54001bb0-a6c9-46ef-984e-96d8d49d5aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.975003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54001bb0-a6c9-46ef-984e-96d8d49d5aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.975633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54001bb0-a6c9-46ef-984e-96d8d49d5aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.977591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54001bb0-a6c9-46ef-984e-96d8d49d5aa6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.984976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37a33e-6078-4038-95a1-5d41e1ae8d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6347f95a606f4836bc18d85e18f1b18e, user_id=655887220a0e4c41b6fc931c22264f22, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.987934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37a33e-6078-4038-95a1-5d41e1ae8d2b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:14.048902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1265/2508] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:14.053014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54001bb0-a6c9-46ef-984e-96d8d49d5aa6 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:14.060202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1244/2509] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:13 2022] PUT /identity/v3/projects/6347f95a606f4836bc18d85e18f1b18e/users/655887220a0e4c41b6fc931c22264f22/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:14.064117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54001bb0-a6c9-46ef-984e-96d8d49d5aa6 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:14.070503 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9193ae-d9f4-4aae-bc05-85129812e11d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.072765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9193ae-d9f4-4aae-bc05-85129812e11d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.072765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9193ae-d9f4-4aae-bc05-85129812e11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.102172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-4f9193ae-d9f4-4aae-bc05-85129812e11d None None] MFA Rules not processed for user `655887220a0e4c41b6fc931c22264f22`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:14.103527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4f9193ae-d9f4-4aae-bc05-85129812e11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:14.130976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073db6fc-e70b-41cd-80a8-fb81b887a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:14.131772 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073db6fc-e70b-41cd-80a8-fb81b887a844 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.132295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073db6fc-e70b-41cd-80a8-fb81b887a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.132611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073db6fc-e70b-41cd-80a8-fb81b887a844 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.133279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073db6fc-e70b-41cd-80a8-fb81b887a844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:14.134897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073db6fc-e70b-41cd-80a8-fb81b887a844 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:14.147241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1266/2510] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:14.148970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:14.153281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073db6fc-e70b-41cd-80a8-fb81b887a844 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:14.163603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073db6fc-e70b-41cd-80a8-fb81b887a844 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:14.170155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fe281-35ab-4f19-86fe-c1a39c6deee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:14.170944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fe281-35ab-4f19-86fe-c1a39c6deee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.171341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fe281-35ab-4f19-86fe-c1a39c6deee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.172120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fe281-35ab-4f19-86fe-c1a39c6deee8 admin admin] PATH_INFO: `/v3/projects/cc3dad1dc9d34fcb8f85d60a5a78517c/users/a1432f8e09c44b24b04ac9de8f18f37c/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.182437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1245/2511] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:14.190551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fe281-35ab-4f19-86fe-c1a39c6deee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3dad1dc9d34fcb8f85d60a5a78517c, user_id=a1432f8e09c44b24b04ac9de8f18f37c, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:14.193623 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fe281-35ab-4f19-86fe-c1a39c6deee8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:14.194209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9193ae-d9f4-4aae-bc05-85129812e11d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:14.195778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4f9193ae-d9f4-4aae-bc05-85129812e11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:14.238313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:14.273592 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9193ae-d9f4-4aae-bc05-85129812e11d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:14.276881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1267/2512] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:14 2022] PUT /identity/v3/projects/cc3dad1dc9d34fcb8f85d60a5a78517c/users/a1432f8e09c44b24b04ac9de8f18f37c/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:14.282342 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fe281-35ab-4f19-86fe-c1a39c6deee8 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:14.351939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fe281-35ab-4f19-86fe-c1a39c6deee8 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:14.354646 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e33180-5d0a-4416-be6b-3a2c1df7c329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:14.355461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e33180-5d0a-4416-be6b-3a2c1df7c329 service nova] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.355659 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e33180-5d0a-4416-be6b-3a2c1df7c329 service nova] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.355939 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e33180-5d0a-4416-be6b-3a2c1df7c329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.356733 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c63d31-a713-4f5e-afa5-a2b4827860be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:14.357393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c63d31-a713-4f5e-afa5-a2b4827860be admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.357671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c63d31-a713-4f5e-afa5-a2b4827860be admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.357939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c63d31-a713-4f5e-afa5-a2b4827860be admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.358579 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c63d31-a713-4f5e-afa5-a2b4827860be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:14.360268 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c63d31-a713-4f5e-afa5-a2b4827860be admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:14.374506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1268/2513] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:14.375454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c63d31-a713-4f5e-afa5-a2b4827860be admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:14.386818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c63d31-a713-4f5e-afa5-a2b4827860be admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:14.393293 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce64c9-208c-4e4a-9629-1b7812f3b969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:14.396201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce64c9-208c-4e4a-9629-1b7812f3b969 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.396201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce64c9-208c-4e4a-9629-1b7812f3b969 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.396201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce64c9-208c-4e4a-9629-1b7812f3b969 admin admin] PATH_INFO: `/v3/projects/cc3dad1dc9d34fcb8f85d60a5a78517c/users/a1432f8e09c44b24b04ac9de8f18f37c/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.397224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce64c9-208c-4e4a-9629-1b7812f3b969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3dad1dc9d34fcb8f85d60a5a78517c, user_id=a1432f8e09c44b24b04ac9de8f18f37c, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:14.399352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce64c9-208c-4e4a-9629-1b7812f3b969 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:14.416920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1269/2514] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:14 2022] PUT /identity/v3/projects/cc3dad1dc9d34fcb8f85d60a5a78517c/users/a1432f8e09c44b24b04ac9de8f18f37c/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:14.428929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28da1-502a-404f-a419-13982f75acb3 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.429539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28da1-502a-404f-a419-13982f75acb3 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.429976 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28da1-502a-404f-a419-13982f75acb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.444305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e33180-5d0a-4416-be6b-3a2c1df7c329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:14.446175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e33180-5d0a-4416-be6b-3a2c1df7c329 service nova] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:14.456240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1246/2515] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:14.462661 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-6da28da1-502a-404f-a419-13982f75acb3 None None] MFA Rules not processed for user `a1432f8e09c44b24b04ac9de8f18f37c`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:14.463433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6da28da1-502a-404f-a419-13982f75acb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:14.522915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:14.557063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1270/2516] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:14.600636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e33180-5d0a-4416-be6b-3a2c1df7c329 service nova] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:14.600636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-58e33180-5d0a-4416-be6b-3a2c1df7c329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:14.684439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e33180-5d0a-4416-be6b-3a2c1df7c329 service nova] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:14.714207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:14.735984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da28da1-502a-404f-a419-13982f75acb3 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:14.743565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96d55d-f7d7-466f-9f56-7b8d079f476b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:14.744196 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d55d-f7d7-466f-9f56-7b8d079f476b service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.744608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d55d-f7d7-466f-9f56-7b8d079f476b service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.744834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d55d-f7d7-466f-9f56-7b8d079f476b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.808024 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96d55d-f7d7-466f-9f56-7b8d079f476b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:14.809505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96d55d-f7d7-466f-9f56-7b8d079f476b service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:14.814975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da28da1-502a-404f-a419-13982f75acb3 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:14.819778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:14.820418 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.820588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1247/2517] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:14.822435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.822712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] PATH_INFO: `/v3/users/655887220a0e4c41b6fc931c22264f22` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.823908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=655887220a0e4c41b6fc931c22264f22)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:14.826539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.005497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655887220a0e4c41b6fc931c22264f22'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.012794 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655887220a0e4c41b6fc931c22264f22'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.099783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655887220a0e4c41b6fc931c22264f22'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.100482 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655887220a0e4c41b6fc931c22264f22'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.101162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655887220a0e4c41b6fc931c22264f22'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.119948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1271/2518] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:14 2022] DELETE /identity/v3/users/655887220a0e4c41b6fc931c22264f22 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:15.125323 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae5b7-b2f9-41ce-8335-6f464d14cf1b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.125603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae5b7-b2f9-41ce-8335-6f464d14cf1b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.125872 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ae5b7-b2f9-41ce-8335-6f464d14cf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.146072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-1a9ae5b7-b2f9-41ce-8335-6f464d14cf1b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:15.147298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1a9ae5b7-b2f9-41ce-8335-6f464d14cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.209469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1248/2519] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:15.219524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.221119 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.280596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8947ea1-b608-4f63-9e81-b6735a90dc85 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.284327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70cdf6-675b-4ad2-88e1-e4e8df762266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.285084 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70cdf6-675b-4ad2-88e1-e4e8df762266 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.285296 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70cdf6-675b-4ad2-88e1-e4e8df762266 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.285566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70cdf6-675b-4ad2-88e1-e4e8df762266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.296335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70cdf6-675b-4ad2-88e1-e4e8df762266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.297861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70cdf6-675b-4ad2-88e1-e4e8df762266 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.307634 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1272/2520] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:15.691844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ae5b7-b2f9-41ce-8335-6f464d14cf1b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.693415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1a9ae5b7-b2f9-41ce-8335-6f464d14cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.705935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ae5b7-b2f9-41ce-8335-6f464d14cf1b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.713237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.713881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.714157 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.714431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] PATH_INFO: `/v3/users/555848c3c2fe430d903091d887eb0478` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.715621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=555848c3c2fe430d903091d887eb0478)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.718139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.840083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70cdf6-675b-4ad2-88e1-e4e8df762266 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.842236 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6e70cdf6-675b-4ad2-88e1-e4e8df762266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.855134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:15.860755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70cdf6-675b-4ad2-88e1-e4e8df762266 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.866723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.867499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.867818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.868168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] PATH_INFO: `/v3/projects/6347f95a606f4836bc18d85e18f1b18e` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.869240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6347f95a606f4836bc18d85e18f1b18e)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.871153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.931183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555848c3c2fe430d903091d887eb0478'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.944565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555848c3c2fe430d903091d887eb0478'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.016054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6347f95a606f4836bc18d85e18f1b18e', 'request_id': 'req-28205061-aa33-4385-85fa-c228d9f53a9d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.021601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6347f95a606f4836bc18d85e18f1b18e', 'request_id': 'req-28205061-aa33-4385-85fa-c228d9f53a9d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.025567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555848c3c2fe430d903091d887eb0478'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.026253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555848c3c2fe430d903091d887eb0478'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.029445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6347f95a606f4836bc18d85e18f1b18e', 'request_id': 'req-28205061-aa33-4385-85fa-c228d9f53a9d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.031324 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:16.034541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-162b046c-57f7-4b38-90ad-ca361abe69d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555848c3c2fe430d903091d887eb0478'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.041320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1249/2521] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:15 2022] DELETE /identity/v3/users/555848c3c2fe430d903091d887eb0478 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:16.045838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba4b0f-d943-4126-8a32-438c85865341 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.046218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba4b0f-d943-4126-8a32-438c85865341 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.046494 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba4b0f-d943-4126-8a32-438c85865341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.067515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-26ba4b0f-d943-4126-8a32-438c85865341 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:16.068723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-26ba4b0f-d943-4126-8a32-438c85865341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.134242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1250/2522] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:16.145414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba4b0f-d943-4126-8a32-438c85865341 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.147122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-26ba4b0f-d943-4126-8a32-438c85865341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.162349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] The token cache is being invalidate because project 6347f95a606f4836bc18d85e18f1b18e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:16.162646 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.163315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-28205061-aa33-4385-85fa-c228d9f53a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.164879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1273/2523] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:15 2022] DELETE /identity/v3/projects/6347f95a606f4836bc18d85e18f1b18e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:16.170404 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a22b7b-b3a7-468e-bba1-5614753d32c6 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.170705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a22b7b-b3a7-468e-bba1-5614753d32c6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.171081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a22b7b-b3a7-468e-bba1-5614753d32c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.193295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-42a22b7b-b3a7-468e-bba1-5614753d32c6 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:16.194596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-42a22b7b-b3a7-468e-bba1-5614753d32c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.204109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1274/2524] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:16.212922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4f8b-99a0-4b73-b446-8af791f4570c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.213374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4f8b-99a0-4b73-b446-8af791f4570c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.214018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e4f8b-99a0-4b73-b446-8af791f4570c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.218937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba4b0f-d943-4126-8a32-438c85865341 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.225030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd985e1d-d0a1-40a0-93b2-a287ba7a7e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.225978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd985e1d-d0a1-40a0-93b2-a287ba7a7e36 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.226375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd985e1d-d0a1-40a0-93b2-a287ba7a7e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.226775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd985e1d-d0a1-40a0-93b2-a287ba7a7e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.229362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fd985e1d-d0a1-40a0-93b2-a287ba7a7e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.244861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-f47e4f8b-99a0-4b73-b446-8af791f4570c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:16.246733 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f47e4f8b-99a0-4b73-b446-8af791f4570c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.249212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd985e1d-d0a1-40a0-93b2-a287ba7a7e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.250882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd985e1d-d0a1-40a0-93b2-a287ba7a7e36 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.256600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1275/2525] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:16.261093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e4f8b-99a0-4b73-b446-8af791f4570c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.265532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1251/2526] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:16.272731 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e4f8b-99a0-4b73-b446-8af791f4570c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.277740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575de2-d845-4af0-8c9c-1fdf955c778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.278392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575de2-d845-4af0-8c9c-1fdf955c778b admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.278639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575de2-d845-4af0-8c9c-1fdf955c778b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.278940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575de2-d845-4af0-8c9c-1fdf955c778b admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.279603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575de2-d845-4af0-8c9c-1fdf955c778b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:16.280310 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575de2-d845-4af0-8c9c-1fdf955c778b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.281678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575de2-d845-4af0-8c9c-1fdf955c778b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.301719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1276/2527] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:04:16.306415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd985e1d-d0a1-40a0-93b2-a287ba7a7e36 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.320349 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd985e1d-d0a1-40a0-93b2-a287ba7a7e36 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.323151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157be04b-767c-4352-8ad2-8ccbd59c3990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.323845 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be04b-767c-4352-8ad2-8ccbd59c3990 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.324069 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be04b-767c-4352-8ad2-8ccbd59c3990 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.324339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be04b-767c-4352-8ad2-8ccbd59c3990 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.325121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157be04b-767c-4352-8ad2-8ccbd59c3990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.327691 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157be04b-767c-4352-8ad2-8ccbd59c3990 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.439896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1252/2528] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:16 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:16.444857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575de2-d845-4af0-8c9c-1fdf955c778b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.462247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575de2-d845-4af0-8c9c-1fdf955c778b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.569852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c29c-aa12-484e-b129-cd40dfe7455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.571049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c29c-aa12-484e-b129-cd40dfe7455b admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.571563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c29c-aa12-484e-b129-cd40dfe7455b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.572063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77c29c-aa12-484e-b129-cd40dfe7455b admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.573237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77c29c-aa12-484e-b129-cd40dfe7455b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.577316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77c29c-aa12-484e-b129-cd40dfe7455b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.677117 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1277/2529] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:16 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:16.681690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157be04b-767c-4352-8ad2-8ccbd59c3990 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.692987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157be04b-767c-4352-8ad2-8ccbd59c3990 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.697520 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175d3ef-f64c-4fb3-b760-f58ee93e7137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.698113 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175d3ef-f64c-4fb3-b760-f58ee93e7137 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.698392 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175d3ef-f64c-4fb3-b760-f58ee93e7137 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.698656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175d3ef-f64c-4fb3-b760-f58ee93e7137 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.699287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175d3ef-f64c-4fb3-b760-f58ee93e7137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.700991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175d3ef-f64c-4fb3-b760-f58ee93e7137 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.713499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c29c-aa12-484e-b129-cd40dfe7455b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.717705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1253/2530] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:16.721432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fd77c29c-aa12-484e-b129-cd40dfe7455b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.721751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175d3ef-f64c-4fb3-b760-f58ee93e7137 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.733249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175d3ef-f64c-4fb3-b760-f58ee93e7137 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.734541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77c29c-aa12-484e-b129-cd40dfe7455b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.738290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d66828-743a-40c1-98ff-b6c9c100f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.738906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66828-743a-40c1-98ff-b6c9c100f345 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.739192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66828-743a-40c1-98ff-b6c9c100f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.739450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d66828-743a-40c1-98ff-b6c9c100f345 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.740095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d66828-743a-40c1-98ff-b6c9c100f345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.740319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.740991 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.741270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.741544 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] PATH_INFO: `/v3/projects/70f09b2221df4300923be2732f3c37ce` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.741739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d66828-743a-40c1-98ff-b6c9c100f345 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.743025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f09b2221df4300923be2732f3c37ce)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.744870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.753288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1254/2531] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:16.757508 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d66828-743a-40c1-98ff-b6c9c100f345 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.767431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d66828-743a-40c1-98ff-b6c9c100f345 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.772821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8427258-c1d5-4f9c-a1a2-e3a2932e345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.776701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8427258-c1d5-4f9c-a1a2-e3a2932e345f admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.776701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8427258-c1d5-4f9c-a1a2-e3a2932e345f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.776701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8427258-c1d5-4f9c-a1a2-e3a2932e345f admin admin] PATH_INFO: `/v3/projects/65e063f327034f71ab4a04a7950306e2/users/44aeff440954402e9dc90e7fcd2dbeb5/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.790204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8427258-c1d5-4f9c-a1a2-e3a2932e345f admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e063f327034f71ab4a04a7950306e2, user_id=44aeff440954402e9dc90e7fcd2dbeb5, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.792962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8427258-c1d5-4f9c-a1a2-e3a2932e345f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.923781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1255/2532] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:16 2022] PUT /identity/v3/projects/65e063f327034f71ab4a04a7950306e2/users/44aeff440954402e9dc90e7fcd2dbeb5/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:16.933875 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:16.936213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0fe9-bd44-43c0-8975-1001fccaf527 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.936492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0fe9-bd44-43c0-8975-1001fccaf527 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.936798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a0fe9-bd44-43c0-8975-1001fccaf527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.938092 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f09b2221df4300923be2732f3c37ce', 'request_id': 'req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.943908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f09b2221df4300923be2732f3c37ce', 'request_id': 'req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.950846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f09b2221df4300923be2732f3c37ce', 'request_id': 'req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.964672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-343a0fe9-bd44-43c0-8975-1001fccaf527 None None] MFA Rules not processed for user `44aeff440954402e9dc90e7fcd2dbeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:16.965894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-343a0fe9-bd44-43c0-8975-1001fccaf527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:17.032768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1256/2533] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:17.037192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a0fe9-bd44-43c0-8975-1001fccaf527 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.077114 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] The token cache is being invalidate because project 70f09b2221df4300923be2732f3c37ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:17.077392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:17.078065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:17.079593 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1278/2534] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:16 2022] DELETE /identity/v3/projects/70f09b2221df4300923be2732f3c37ce => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:17.083781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.085381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:17.114524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a0fe9-bd44-43c0-8975-1001fccaf527 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:17.114524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:17.114524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb682-f008-4697-b9f5-6353c7303bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:17.114524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb682-f008-4697-b9f5-6353c7303bfe admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.115072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb682-f008-4697-b9f5-6353c7303bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.115072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb682-f008-4697-b9f5-6353c7303bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.115072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffb682-f008-4697-b9f5-6353c7303bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:17.115072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffb682-f008-4697-b9f5-6353c7303bfe admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:17.152969 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0d36b-fdab-44e8-9509-51ebe760dcaa admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:17.158347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:17.158987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.159262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.159540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] PATH_INFO: `/v3/users/2aec02e6f4304856abb4adffca0900fb` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.160828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aec02e6f4304856abb4adffca0900fb)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:17.162882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:17.222256 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1257/2535] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:17 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:17.226654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb682-f008-4697-b9f5-6353c7303bfe admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.228316 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-35ffb682-f008-4697-b9f5-6353c7303bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:17.293891 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb682-f008-4697-b9f5-6353c7303bfe admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:17.298663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59effc-8093-42bb-903e-9ca1751b04c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:17.299279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59effc-8093-42bb-903e-9ca1751b04c1 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.299559 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59effc-8093-42bb-903e-9ca1751b04c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.299832 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59effc-8093-42bb-903e-9ca1751b04c1 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.300462 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59effc-8093-42bb-903e-9ca1751b04c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:17.302452 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59effc-8093-42bb-903e-9ca1751b04c1 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:17.459692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1258/2536] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:17 2022] POST /identity/v3/users => generated 300 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:17.461589 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59effc-8093-42bb-903e-9ca1751b04c1 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.472923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aec02e6f4304856abb4adffca0900fb'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:17.478932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59effc-8093-42bb-903e-9ca1751b04c1 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:17.480381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aec02e6f4304856abb4adffca0900fb'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:17.483876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffded01-6d62-44ae-858a-6233872d0c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:17.484538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffded01-6d62-44ae-858a-6233872d0c8b admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.484831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffded01-6d62-44ae-858a-6233872d0c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.485101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffded01-6d62-44ae-858a-6233872d0c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.485747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffded01-6d62-44ae-858a-6233872d0c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:17.487338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffded01-6d62-44ae-858a-6233872d0c8b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:17.498536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1259/2537] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:17.503231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffded01-6d62-44ae-858a-6233872d0c8b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.516047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffded01-6d62-44ae-858a-6233872d0c8b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:17.521029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974701b-0843-4edf-8b2a-564bdc55190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:17.521613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974701b-0843-4edf-8b2a-564bdc55190a admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.521888 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974701b-0843-4edf-8b2a-564bdc55190a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.522169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974701b-0843-4edf-8b2a-564bdc55190a admin admin] PATH_INFO: `/v3/projects/ca0ef4bdba2f45558778926f07637865/users/d0f63e224aa84101945d27beb171ae87/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.522807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aec02e6f4304856abb4adffca0900fb'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:17.523881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aec02e6f4304856abb4adffca0900fb'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:17.524496 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aec02e6f4304856abb4adffca0900fb'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:17.537532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974701b-0843-4edf-8b2a-564bdc55190a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0ef4bdba2f45558778926f07637865, user_id=d0f63e224aa84101945d27beb171ae87, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:17.540430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974701b-0843-4edf-8b2a-564bdc55190a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:17.543128 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1279/2538] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:17 2022] DELETE /identity/v3/users/2aec02e6f4304856abb4adffca0900fb => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:17.620764 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1260/2539] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:17 2022] PUT /identity/v3/projects/ca0ef4bdba2f45558778926f07637865/users/d0f63e224aa84101945d27beb171ae87/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:17.625604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.627130 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:17.694982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867ecbb-e515-440a-943d-861d23ee1a92 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:17.722563 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:17.767288 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e584e2-cfb7-4865-8b8e-a92dbf737269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:17.767907 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e584e2-cfb7-4865-8b8e-a92dbf737269 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.768189 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e584e2-cfb7-4865-8b8e-a92dbf737269 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.768568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e584e2-cfb7-4865-8b8e-a92dbf737269 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.770182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e584e2-cfb7-4865-8b8e-a92dbf737269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:17.771377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e584e2-cfb7-4865-8b8e-a92dbf737269 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:17.782771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1280/2540] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:17.786703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974701b-0843-4edf-8b2a-564bdc55190a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.797533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974701b-0843-4edf-8b2a-564bdc55190a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:17.804407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aa9d6-263a-4d03-a58c-d3cb49c1e3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:17.805189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aa9d6-263a-4d03-a58c-d3cb49c1e3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.805476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aa9d6-263a-4d03-a58c-d3cb49c1e3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.805750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aa9d6-263a-4d03-a58c-d3cb49c1e3ed admin admin] PATH_INFO: `/v3/projects/ca0ef4bdba2f45558778926f07637865/users/d0f63e224aa84101945d27beb171ae87/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.807773 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04aa9d6-263a-4d03-a58c-d3cb49c1e3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0ef4bdba2f45558778926f07637865, user_id=d0f63e224aa84101945d27beb171ae87, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:17.808263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:17.811418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04aa9d6-263a-4d03-a58c-d3cb49c1e3ed admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:17.823106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1261/2541] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:17 2022] PUT /identity/v3/projects/ca0ef4bdba2f45558778926f07637865/users/d0f63e224aa84101945d27beb171ae87/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:17.834081 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9fe0-14c3-4bef-964c-bddf4a9f0458 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.834363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9fe0-14c3-4bef-964c-bddf4a9f0458 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.834685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9fe0-14c3-4bef-964c-bddf4a9f0458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.867922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-316e9fe0-14c3-4bef-964c-bddf4a9f0458 None None] MFA Rules not processed for user `d0f63e224aa84101945d27beb171ae87`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:17.869302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-316e9fe0-14c3-4bef-964c-bddf4a9f0458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:17.937450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aa9d6-263a-4d03-a58c-d3cb49c1e3ed admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.939474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e04aa9d6-263a-4d03-a58c-d3cb49c1e3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:17.945076 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1281/2542] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:17.957692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e9fe0-14c3-4bef-964c-bddf4a9f0458 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.959132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-316e9fe0-14c3-4bef-964c-bddf4a9f0458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.026828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aa9d6-263a-4d03-a58c-d3cb49c1e3ed admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.027901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e9fe0-14c3-4bef-964c-bddf4a9f0458 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.031910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc7992-93f6-43c3-b3b4-6f221e9215a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.033059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc7992-93f6-43c3-b3b4-6f221e9215a7 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.033059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc7992-93f6-43c3-b3b4-6f221e9215a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.033278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc7992-93f6-43c3-b3b4-6f221e9215a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.035432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.036225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.036579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.036992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] PATH_INFO: `/v3/users/08eddb6345304c88a5a6c27bd438f513` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.038756 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08eddb6345304c88a5a6c27bd438f513)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.040804 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.045727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc7992-93f6-43c3-b3b4-6f221e9215a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.047617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc7992-93f6-43c3-b3b4-6f221e9215a7 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.068714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1282/2543] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:18.071384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc7992-93f6-43c3-b3b4-6f221e9215a7 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:18.072856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-92fc7992-93f6-43c3-b3b4-6f221e9215a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.087357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc7992-93f6-43c3-b3b4-6f221e9215a7 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.093272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.094049 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.094334 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.094747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] PATH_INFO: `/v3/projects/a3c91645333c402eba214b82b1b8164d` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.095905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c91645333c402eba214b82b1b8164d)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.098158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.223115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c91645333c402eba214b82b1b8164d', 'request_id': 'req-07489a67-6110-4445-b4d2-08dab342680e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.223394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08eddb6345304c88a5a6c27bd438f513'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.229317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c91645333c402eba214b82b1b8164d', 'request_id': 'req-07489a67-6110-4445-b4d2-08dab342680e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.236449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c91645333c402eba214b82b1b8164d', 'request_id': 'req-07489a67-6110-4445-b4d2-08dab342680e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.237516 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08eddb6345304c88a5a6c27bd438f513'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.282640 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:18.305013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] The token cache is being invalidate because project a3c91645333c402eba214b82b1b8164d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:18.305303 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.305947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.307562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1283/2544] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:18 2022] DELETE /identity/v3/projects/a3c91645333c402eba214b82b1b8164d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:18.308341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:18.310418 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.375827 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07489a67-6110-4445-b4d2-08dab342680e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.380781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.381591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.381874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.382149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] PATH_INFO: `/v3/users/44aeff440954402e9dc90e7fcd2dbeb5` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.383333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44aeff440954402e9dc90e7fcd2dbeb5)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.385271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08eddb6345304c88a5a6c27bd438f513'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.385414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.386162 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08eddb6345304c88a5a6c27bd438f513'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.393736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ef2220f6-653b-430e-8ffb-9a52e6deda82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08eddb6345304c88a5a6c27bd438f513'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.400531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1262/2545] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:17 2022] DELETE /identity/v3/users/08eddb6345304c88a5a6c27bd438f513 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:18.401842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd46c1d-6744-46b7-bfe8-cc452051531d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.402125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd46c1d-6744-46b7-bfe8-cc452051531d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.402391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd46c1d-6744-46b7-bfe8-cc452051531d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.424130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7dd46c1d-6744-46b7-bfe8-cc452051531d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:18.425403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7dd46c1d-6744-46b7-bfe8-cc452051531d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.486829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1263/2546] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:18.488324 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e6af-f73f-479b-8c59-2ec8c26afb5b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.488641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e6af-f73f-479b-8c59-2ec8c26afb5b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.488916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e6af-f73f-479b-8c59-2ec8c26afb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.504711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:18.508807 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-9260e6af-f73f-479b-8c59-2ec8c26afb5b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:18.510078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9260e6af-f73f-479b-8c59-2ec8c26afb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.518187 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1264/2547] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:18.519433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93843-598d-4ed4-865e-3eee0e16c94b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.519718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93843-598d-4ed4-865e-3eee0e16c94b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.519994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93843-598d-4ed4-865e-3eee0e16c94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.540453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-48a93843-598d-4ed4-865e-3eee0e16c94b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:18.543781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-48a93843-598d-4ed4-865e-3eee0e16c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.550525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1265/2548] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:18.551348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a93843-598d-4ed4-865e-3eee0e16c94b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:18.552639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-48a93843-598d-4ed4-865e-3eee0e16c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.606104 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44aeff440954402e9dc90e7fcd2dbeb5'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.613070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a93843-598d-4ed4-865e-3eee0e16c94b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.614275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44aeff440954402e9dc90e7fcd2dbeb5'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.617483 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e508a0f-be77-4b83-803a-4fff8ef7a911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.618260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e508a0f-be77-4b83-803a-4fff8ef7a911 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.618527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e508a0f-be77-4b83-803a-4fff8ef7a911 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.618797 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e508a0f-be77-4b83-803a-4fff8ef7a911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.628286 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e508a0f-be77-4b83-803a-4fff8ef7a911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.629800 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e508a0f-be77-4b83-803a-4fff8ef7a911 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.640469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1266/2549] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:18.641348 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e508a0f-be77-4b83-803a-4fff8ef7a911 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:18.651306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e508a0f-be77-4b83-803a-4fff8ef7a911 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.656910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92145b-e7e5-4ef2-8ad9-dcda222d22ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.657513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92145b-e7e5-4ef2-8ad9-dcda222d22ce admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.657792 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92145b-e7e5-4ef2-8ad9-dcda222d22ce admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.658062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92145b-e7e5-4ef2-8ad9-dcda222d22ce admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.658706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92145b-e7e5-4ef2-8ad9-dcda222d22ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:18.659104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92145b-e7e5-4ef2-8ad9-dcda222d22ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.660728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92145b-e7e5-4ef2-8ad9-dcda222d22ce admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.676365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1267/2550] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:18.677732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92145b-e7e5-4ef2-8ad9-dcda222d22ce admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:18.688852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92145b-e7e5-4ef2-8ad9-dcda222d22ce admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.694295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44aeff440954402e9dc90e7fcd2dbeb5'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.694490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d50294-f080-422e-8457-a29ab6e42d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.694962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44aeff440954402e9dc90e7fcd2dbeb5'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.695132 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d50294-f080-422e-8457-a29ab6e42d3c admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.695254 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d50294-f080-422e-8457-a29ab6e42d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.695502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d50294-f080-422e-8457-a29ab6e42d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.695906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f65840fb-8096-47b9-9327-6323dc6a0576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44aeff440954402e9dc90e7fcd2dbeb5'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.696145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d50294-f080-422e-8457-a29ab6e42d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.698905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d50294-f080-422e-8457-a29ab6e42d3c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.720055 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1284/2551] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:18 2022] DELETE /identity/v3/users/44aeff440954402e9dc90e7fcd2dbeb5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:18.724751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e21e9-d79a-48b0-beb9-519f504fb77d None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.725123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e21e9-d79a-48b0-beb9-519f504fb77d None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.725405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e21e9-d79a-48b0-beb9-519f504fb77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.745184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-892e21e9-d79a-48b0-beb9-519f504fb77d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:18.746436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-892e21e9-d79a-48b0-beb9-519f504fb77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.766134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:18.781370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1268/2552] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:18 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:18.785536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d50294-f080-422e-8457-a29ab6e42d3c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:18.787193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-97d50294-f080-422e-8457-a29ab6e42d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.816767 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1285/2553] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:18.827979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e21e9-d79a-48b0-beb9-519f504fb77d None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:18.829737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-892e21e9-d79a-48b0-beb9-519f504fb77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.882537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d50294-f080-422e-8457-a29ab6e42d3c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.891957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27232d68-3594-45ea-9605-3d233a09ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.892929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232d68-3594-45ea-9605-3d233a09ef73 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.892929 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232d68-3594-45ea-9605-3d233a09ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.893184 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232d68-3594-45ea-9605-3d233a09ef73 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.893956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27232d68-3594-45ea-9605-3d233a09ef73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.896028 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27232d68-3594-45ea-9605-3d233a09ef73 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.903858 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e21e9-d79a-48b0-beb9-519f504fb77d None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.967793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca50d0-f163-499d-891c-93aad4ecfb76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.968427 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca50d0-f163-499d-891c-93aad4ecfb76 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.968726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca50d0-f163-499d-891c-93aad4ecfb76 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.968997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca50d0-f163-499d-891c-93aad4ecfb76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.979129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca50d0-f163-499d-891c-93aad4ecfb76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.980622 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca50d0-f163-499d-891c-93aad4ecfb76 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.993309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1269/2554] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:18 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:18.996017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27232d68-3594-45ea-9605-3d233a09ef73 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.001044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1286/2555] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:19.008275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27232d68-3594-45ea-9605-3d233a09ef73 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.013656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab459e9-dd9c-4c2a-96d3-fe0885d0ffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.014279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab459e9-dd9c-4c2a-96d3-fe0885d0ffd4 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.014583 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab459e9-dd9c-4c2a-96d3-fe0885d0ffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.014855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab459e9-dd9c-4c2a-96d3-fe0885d0ffd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.015481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab459e9-dd9c-4c2a-96d3-fe0885d0ffd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.017313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab459e9-dd9c-4c2a-96d3-fe0885d0ffd4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.029413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1270/2556] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:19.033660 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca50d0-f163-499d-891c-93aad4ecfb76 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.050758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca50d0-f163-499d-891c-93aad4ecfb76 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.055462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6a689-8b52-4fbc-ba71-66ae888e0b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.056416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6a689-8b52-4fbc-ba71-66ae888e0b87 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.056416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6a689-8b52-4fbc-ba71-66ae888e0b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.057233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6a689-8b52-4fbc-ba71-66ae888e0b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.057233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6a689-8b52-4fbc-ba71-66ae888e0b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.058834 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6a689-8b52-4fbc-ba71-66ae888e0b87 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.071711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1287/2557] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:19.077412 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab459e9-dd9c-4c2a-96d3-fe0885d0ffd4 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.078050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6a689-8b52-4fbc-ba71-66ae888e0b87 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.080232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0ab459e9-dd9c-4c2a-96d3-fe0885d0ffd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.089692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6a689-8b52-4fbc-ba71-66ae888e0b87 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.099983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cf59a-18c8-4e64-8a2d-3db453c06f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.101041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf59a-18c8-4e64-8a2d-3db453c06f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.102620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf59a-18c8-4e64-8a2d-3db453c06f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.102620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cf59a-18c8-4e64-8a2d-3db453c06f9c admin admin] PATH_INFO: `/v3/projects/ddec1e01a3cd43568c9784fe18b3863d/users/0eacdae742354b6fb6b48127da614f77/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.120965 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab459e9-dd9c-4c2a-96d3-fe0885d0ffd4 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.126824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cf59a-18c8-4e64-8a2d-3db453c06f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddec1e01a3cd43568c9784fe18b3863d, user_id=0eacdae742354b6fb6b48127da614f77, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.129696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.130293 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cf59a-18c8-4e64-8a2d-3db453c06f9c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.130416 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.130621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.130881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] PATH_INFO: `/v3/projects/eb60fdb3301f4d2690197d2976fa9d33` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.132790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb60fdb3301f4d2690197d2976fa9d33)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.135151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.231678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1288/2558] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:19 2022] PUT /identity/v3/projects/ddec1e01a3cd43568c9784fe18b3863d/users/0eacdae742354b6fb6b48127da614f77/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:19.242826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d02961-f91d-466c-81f5-69b3487bccec None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.243112 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d02961-f91d-466c-81f5-69b3487bccec None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.243437 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d02961-f91d-466c-81f5-69b3487bccec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.272750 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-98d02961-f91d-466c-81f5-69b3487bccec None None] MFA Rules not processed for user `0eacdae742354b6fb6b48127da614f77`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:19.273993 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-98d02961-f91d-466c-81f5-69b3487bccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.285613 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:19.300048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb60fdb3301f4d2690197d2976fa9d33', 'request_id': 'req-5448fff0-3351-4411-a5e4-1d4a409f44cf'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.327911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:19.359381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1289/2559] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:19.364170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d02961-f91d-466c-81f5-69b3487bccec None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.390766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb60fdb3301f4d2690197d2976fa9d33', 'request_id': 'req-5448fff0-3351-4411-a5e4-1d4a409f44cf'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.399418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb60fdb3301f4d2690197d2976fa9d33', 'request_id': 'req-5448fff0-3351-4411-a5e4-1d4a409f44cf'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.414421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] The token cache is being invalidate because project eb60fdb3301f4d2690197d2976fa9d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:19.414714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.415801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.417533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1271/2560] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:19 2022] DELETE /identity/v3/projects/eb60fdb3301f4d2690197d2976fa9d33 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:19.421570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.423006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.451254 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d02961-f91d-466c-81f5-69b3487bccec None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.512441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144745f4-64f8-461f-b431-1c301712abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.513006 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144745f4-64f8-461f-b431-1c301712abe7 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.515334 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144745f4-64f8-461f-b431-1c301712abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.515521 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448fff0-3351-4411-a5e4-1d4a409f44cf admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.515800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144745f4-64f8-461f-b431-1c301712abe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.515800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144745f4-64f8-461f-b431-1c301712abe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.516981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144745f4-64f8-461f-b431-1c301712abe7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.519310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.520131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.520419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.520864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] PATH_INFO: `/v3/users/a1432f8e09c44b24b04ac9de8f18f37c` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.522047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1432f8e09c44b24b04ac9de8f18f37c)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.523988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.627824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1290/2561] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:19 2022] POST /identity/v3/projects => generated 385 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:19.627824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144745f4-64f8-461f-b431-1c301712abe7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.627824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-144745f4-64f8-461f-b431-1c301712abe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.694574 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144745f4-64f8-461f-b431-1c301712abe7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.699879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.700536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.701366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.701637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] PATH_INFO: `/v3/projects/65e063f327034f71ab4a04a7950306e2` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.702821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e063f327034f71ab4a04a7950306e2)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.704770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.717549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:19.742631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1432f8e09c44b24b04ac9de8f18f37c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.756260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1432f8e09c44b24b04ac9de8f18f37c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.885328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e063f327034f71ab4a04a7950306e2', 'request_id': 'req-5b31616a-22f0-460a-a46c-cd850522dca3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.891992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e063f327034f71ab4a04a7950306e2', 'request_id': 'req-5b31616a-22f0-460a-a46c-cd850522dca3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.898409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e063f327034f71ab4a04a7950306e2', 'request_id': 'req-5b31616a-22f0-460a-a46c-cd850522dca3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.899384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1432f8e09c44b24b04ac9de8f18f37c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.900009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1432f8e09c44b24b04ac9de8f18f37c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.909186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1432f8e09c44b24b04ac9de8f18f37c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.915678 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1272/2562] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:19 2022] DELETE /identity/v3/users/a1432f8e09c44b24b04ac9de8f18f37c => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:19.916542 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.918369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.971116 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:19.993041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566e66d-6bee-4caa-b338-441173472256 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.998619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82e00-64c2-4f28-b93f-5801aef9e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.999332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82e00-64c2-4f28-b93f-5801aef9e6bc admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.999612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82e00-64c2-4f28-b93f-5801aef9e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.000055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82e00-64c2-4f28-b93f-5801aef9e6bc admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.000730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c82e00-64c2-4f28-b93f-5801aef9e6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.002673 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c82e00-64c2-4f28-b93f-5801aef9e6bc admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.014901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] The token cache is being invalidate because project 65e063f327034f71ab4a04a7950306e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:20.015261 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.016449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.017740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1291/2563] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:19 2022] DELETE /identity/v3/projects/65e063f327034f71ab4a04a7950306e2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:20.022008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.023398 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.092344 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31616a-22f0-460a-a46c-cd850522dca3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.098175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.099069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.099480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.099870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] PATH_INFO: `/v3/users/d0f63e224aa84101945d27beb171ae87` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.101050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f63e224aa84101945d27beb171ae87)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.102972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.136163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1273/2564] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:19 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:20.140232 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82e00-64c2-4f28-b93f-5801aef9e6bc admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.141960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-65c82e00-64c2-4f28-b93f-5801aef9e6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.155692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82e00-64c2-4f28-b93f-5801aef9e6bc admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.160814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf1d3b-18b8-4183-9542-9deff89d0a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.161477 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf1d3b-18b8-4183-9542-9deff89d0a3d admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.161729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf1d3b-18b8-4183-9542-9deff89d0a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.162001 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf1d3b-18b8-4183-9542-9deff89d0a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.162645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf1d3b-18b8-4183-9542-9deff89d0a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.164241 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf1d3b-18b8-4183-9542-9deff89d0a3d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.176191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1274/2565] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:20.180776 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf1d3b-18b8-4183-9542-9deff89d0a3d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.193033 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf1d3b-18b8-4183-9542-9deff89d0a3d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.198021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650e188-a7ef-4d0e-a833-d7f2dc933cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.198641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650e188-a7ef-4d0e-a833-d7f2dc933cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.198947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650e188-a7ef-4d0e-a833-d7f2dc933cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.199222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650e188-a7ef-4d0e-a833-d7f2dc933cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.199887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650e188-a7ef-4d0e-a833-d7f2dc933cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.201716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650e188-a7ef-4d0e-a833-d7f2dc933cb2 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.213490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1275/2566] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:20.218231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650e188-a7ef-4d0e-a833-d7f2dc933cb2 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.228337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650e188-a7ef-4d0e-a833-d7f2dc933cb2 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.235322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97209c98-cea0-431e-bd44-b42b2a3f1121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.236003 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97209c98-cea0-431e-bd44-b42b2a3f1121 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.236281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97209c98-cea0-431e-bd44-b42b2a3f1121 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.236575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97209c98-cea0-431e-bd44-b42b2a3f1121 admin admin] PATH_INFO: `/v3/projects/58062eb043404b779fe07df1a91edd54/users/7746e72312ea473ebdc4b5a82336fb55/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.256627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97209c98-cea0-431e-bd44-b42b2a3f1121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58062eb043404b779fe07df1a91edd54, user_id=7746e72312ea473ebdc4b5a82336fb55, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.256627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97209c98-cea0-431e-bd44-b42b2a3f1121 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.330458 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f63e224aa84101945d27beb171ae87'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.337982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f63e224aa84101945d27beb171ae87'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.357356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1276/2567] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:20 2022] PUT /identity/v3/projects/58062eb043404b779fe07df1a91edd54/users/7746e72312ea473ebdc4b5a82336fb55/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:20.367702 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411cd4-8670-4f35-9834-f6e25e857150 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.367984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411cd4-8670-4f35-9834-f6e25e857150 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.368255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411cd4-8670-4f35-9834-f6e25e857150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.396809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-3f411cd4-8670-4f35-9834-f6e25e857150 None None] MFA Rules not processed for user `7746e72312ea473ebdc4b5a82336fb55`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:20.397969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3f411cd4-8670-4f35-9834-f6e25e857150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.454944 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f63e224aa84101945d27beb171ae87'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.455872 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f63e224aa84101945d27beb171ae87'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.456480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f63e224aa84101945d27beb171ae87'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.473875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1277/2568] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:20.474812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f411cd4-8670-4f35-9834-f6e25e857150 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.476156 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3f411cd4-8670-4f35-9834-f6e25e857150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.479262 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1292/2569] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:20 2022] DELETE /identity/v3/users/d0f63e224aa84101945d27beb171ae87 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:20.480168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.483274 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.509852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:20.559591 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f411cd4-8670-4f35-9834-f6e25e857150 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.564962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.565692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.565988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.566531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] PATH_INFO: `/v3/projects/cc3dad1dc9d34fcb8f85d60a5a78517c` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.566650 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda67092-8fac-414c-b8d2-c0c842714144 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.567762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3dad1dc9d34fcb8f85d60a5a78517c)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.569922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.571814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56f442-3637-4b02-8aeb-42f93109a704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.577241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56f442-3637-4b02-8aeb-42f93109a704 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.577241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56f442-3637-4b02-8aeb-42f93109a704 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.577241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56f442-3637-4b02-8aeb-42f93109a704 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.577241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56f442-3637-4b02-8aeb-42f93109a704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.577241 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56f442-3637-4b02-8aeb-42f93109a704 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.593510 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:20.697138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1293/2570] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:20 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:20.701168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56f442-3637-4b02-8aeb-42f93109a704 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.725949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3dad1dc9d34fcb8f85d60a5a78517c', 'request_id': 'req-5685f498-ce19-44c3-98f8-03498fcd5af3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.784087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56f442-3637-4b02-8aeb-42f93109a704 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.788959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6fef4-02ab-4329-b1f8-2e57a0211c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.789589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6fef4-02ab-4329-b1f8-2e57a0211c14 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.789866 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6fef4-02ab-4329-b1f8-2e57a0211c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.790138 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6fef4-02ab-4329-b1f8-2e57a0211c14 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.790766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6fef4-02ab-4329-b1f8-2e57a0211c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.793631 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6fef4-02ab-4329-b1f8-2e57a0211c14 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.813486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3dad1dc9d34fcb8f85d60a5a78517c', 'request_id': 'req-5685f498-ce19-44c3-98f8-03498fcd5af3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.821851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3dad1dc9d34fcb8f85d60a5a78517c', 'request_id': 'req-5685f498-ce19-44c3-98f8-03498fcd5af3'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.834742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] The token cache is being invalidate because project cc3dad1dc9d34fcb8f85d60a5a78517c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:20.835063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.835746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5685f498-ce19-44c3-98f8-03498fcd5af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.837326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1278/2571] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:20 2022] DELETE /identity/v3/projects/cc3dad1dc9d34fcb8f85d60a5a78517c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:20.843579 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c62c-f4ae-421d-ba71-25a65e38e4a5 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.843861 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c62c-f4ae-421d-ba71-25a65e38e4a5 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.844167 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c62c-f4ae-421d-ba71-25a65e38e4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.917729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1294/2572] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:20 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:20.923267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6fef4-02ab-4329-b1f8-2e57a0211c14 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.925132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4bf6fef4-02ab-4329-b1f8-2e57a0211c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.940835 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6fef4-02ab-4329-b1f8-2e57a0211c14 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.952497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84010d-ec43-4c6c-9bf7-63d993e682dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.953187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84010d-ec43-4c6c-9bf7-63d993e682dd admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.953539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84010d-ec43-4c6c-9bf7-63d993e682dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.953777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84010d-ec43-4c6c-9bf7-63d993e682dd admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.954457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84010d-ec43-4c6c-9bf7-63d993e682dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.956119 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84010d-ec43-4c6c-9bf7-63d993e682dd admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.999071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1295/2573] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:20.999071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84010d-ec43-4c6c-9bf7-63d993e682dd admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.999071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7c84010d-ec43-4c6c-9bf7-63d993e682dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.999071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84010d-ec43-4c6c-9bf7-63d993e682dd admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.002816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-5923c62c-f4ae-421d-ba71-25a65e38e4a5 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:21.004057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5923c62c-f4ae-421d-ba71-25a65e38e4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.004832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.005560 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.005978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.006380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] PATH_INFO: `/v3/projects/ca0ef4bdba2f45558778926f07637865` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.007674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0ef4bdba2f45558778926f07637865)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.009810 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.014199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1279/2574] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:21.015277 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c62c-f4ae-421d-ba71-25a65e38e4a5 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.025171 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c62c-f4ae-421d-ba71-25a65e38e4a5 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.030944 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc77b1c-9ddc-4f35-a86b-48f535facc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.031611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc77b1c-9ddc-4f35-a86b-48f535facc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.031880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc77b1c-9ddc-4f35-a86b-48f535facc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.032146 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc77b1c-9ddc-4f35-a86b-48f535facc55 admin admin] PATH_INFO: `/v3/projects/ca21d71bd6f6464c9f1e004c1710ea65/users/2544c56b1e0849b2866e08b3fcbae4ee/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.048022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc77b1c-9ddc-4f35-a86b-48f535facc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca21d71bd6f6464c9f1e004c1710ea65, user_id=2544c56b1e0849b2866e08b3fcbae4ee, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.051042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc77b1c-9ddc-4f35-a86b-48f535facc55 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.166489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1280/2575] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:21 2022] PUT /identity/v3/projects/ca21d71bd6f6464c9f1e004c1710ea65/users/2544c56b1e0849b2866e08b3fcbae4ee/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:21.166489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7fb30-1ea6-4da8-91fa-0039a03e452b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.166489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7fb30-1ea6-4da8-91fa-0039a03e452b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.166489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7fb30-1ea6-4da8-91fa-0039a03e452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.178685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0ef4bdba2f45558778926f07637865', 'request_id': 'req-549a6993-0cc7-45fc-8326-87edd21720fd'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:21.184717 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0ef4bdba2f45558778926f07637865', 'request_id': 'req-549a6993-0cc7-45fc-8326-87edd21720fd'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:21.187634 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-1ea7fb30-1ea6-4da8-91fa-0039a03e452b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:21.188925 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1ea7fb30-1ea6-4da8-91fa-0039a03e452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.192386 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0ef4bdba2f45558778926f07637865', 'request_id': 'req-549a6993-0cc7-45fc-8326-87edd21720fd'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:21.261148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1281/2576] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:21.262038 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7fb30-1ea6-4da8-91fa-0039a03e452b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.272404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7fb30-1ea6-4da8-91fa-0039a03e452b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.277102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e7a05-5ec2-4d75-bfbf-6f7537fae070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.277701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e7a05-5ec2-4d75-bfbf-6f7537fae070 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.277973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e7a05-5ec2-4d75-bfbf-6f7537fae070 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.278238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e7a05-5ec2-4d75-bfbf-6f7537fae070 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.278924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e7a05-5ec2-4d75-bfbf-6f7537fae070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.280712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e7a05-5ec2-4d75-bfbf-6f7537fae070 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.288449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] The token cache is being invalidate because project ca0ef4bdba2f45558778926f07637865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:21.289327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:21.290247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:21.291365 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1282/2577] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:21.292191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e7a05-5ec2-4d75-bfbf-6f7537fae070 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.293856 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-106e7a05-5ec2-4d75-bfbf-6f7537fae070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.295521 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1296/2578] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:20 2022] DELETE /identity/v3/projects/ca0ef4bdba2f45558778926f07637865 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:21.296440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.297952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.311148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e7a05-5ec2-4d75-bfbf-6f7537fae070 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.314517 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a6993-0cc7-45fc-8326-87edd21720fd admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.317016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7063a4c-c56c-4399-81ec-c375acf38d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.317710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063a4c-c56c-4399-81ec-c375acf38d60 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.317989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063a4c-c56c-4399-81ec-c375acf38d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.318358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7063a4c-c56c-4399-81ec-c375acf38d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.319131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7063a4c-c56c-4399-81ec-c375acf38d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:21.319498 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7063a4c-c56c-4399-81ec-c375acf38d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.319914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ec676-ceed-4932-8314-0d539decfdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.320629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ec676-ceed-4932-8314-0d539decfdfb admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.320912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ec676-ceed-4932-8314-0d539decfdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.321187 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ec676-ceed-4932-8314-0d539decfdfb admin admin] PATH_INFO: `/v3/projects/ca21d71bd6f6464c9f1e004c1710ea65/users/2544c56b1e0849b2866e08b3fcbae4ee/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.321298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7063a4c-c56c-4399-81ec-c375acf38d60 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.323174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ec676-ceed-4932-8314-0d539decfdfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca21d71bd6f6464c9f1e004c1710ea65, user_id=2544c56b1e0849b2866e08b3fcbae4ee, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.326577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ec676-ceed-4932-8314-0d539decfdfb admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.334810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1283/2579] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:21.336087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdab6b5-d6bb-4aac-9841-e7083cbff52e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.336370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdab6b5-d6bb-4aac-9841-e7083cbff52e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.336709 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdab6b5-d6bb-4aac-9841-e7083cbff52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.337727 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1297/2580] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:21 2022] PUT /identity/v3/projects/ca21d71bd6f6464c9f1e004c1710ea65/users/2544c56b1e0849b2866e08b3fcbae4ee/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:21.340783 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ec676-ceed-4932-8314-0d539decfdfb admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.357313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:21.357736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-7cdab6b5-d6bb-4aac-9841-e7083cbff52e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:21.358977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7cdab6b5-d6bb-4aac-9841-e7083cbff52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.409153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:21.413509 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ec676-ceed-4932-8314-0d539decfdfb admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.419093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc729c-f606-4b24-99e2-adc0869cfe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.419704 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc729c-f606-4b24-99e2-adc0869cfe43 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.419983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc729c-f606-4b24-99e2-adc0869cfe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.420247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc729c-f606-4b24-99e2-adc0869cfe43 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.420899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc729c-f606-4b24-99e2-adc0869cfe43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.422846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc729c-f606-4b24-99e2-adc0869cfe43 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.425435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1284/2581] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:21.434345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493d95-4062-415a-a912-f97d9fddee27 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.434345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493d95-4062-415a-a912-f97d9fddee27 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.434345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493d95-4062-415a-a912-f97d9fddee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.462769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ac493d95-4062-415a-a912-f97d9fddee27 None None] MFA Rules not processed for user `2544c56b1e0849b2866e08b3fcbae4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:21.464017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ac493d95-4062-415a-a912-f97d9fddee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.533129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1285/2582] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:21.534440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5c5e5-39a3-4f3c-be01-143b4e316e1a None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.534801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5c5e5-39a3-4f3c-be01-143b4e316e1a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.535083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5c5e5-39a3-4f3c-be01-143b4e316e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.542836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1298/2583] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/projects => generated 391 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:21.547225 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc729c-f606-4b24-99e2-adc0869cfe43 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.557071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-43b5c5e5-39a3-4f3c-be01-143b4e316e1a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:21.558370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-43b5c5e5-39a3-4f3c-be01-143b4e316e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.615366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc729c-f606-4b24-99e2-adc0869cfe43 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.620569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1286/2584] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:21.621530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b026d-4676-487f-9cac-438b82f2688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.621692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5c5e5-39a3-4f3c-be01-143b4e316e1a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.622158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b026d-4676-487f-9cac-438b82f2688b admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.622446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b026d-4676-487f-9cac-438b82f2688b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.623250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b026d-4676-487f-9cac-438b82f2688b admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.623431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-43b5c5e5-39a3-4f3c-be01-143b4e316e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.624057 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b026d-4676-487f-9cac-438b82f2688b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.626402 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b026d-4676-487f-9cac-438b82f2688b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.684137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1299/2585] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:21.685852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5c5e5-39a3-4f3c-be01-143b4e316e1a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.687098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b026d-4676-487f-9cac-438b82f2688b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.691948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee100f3-e0ed-4b9c-b361-ddbb25140ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.692981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee100f3-e0ed-4b9c-b361-ddbb25140ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.693089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee100f3-e0ed-4b9c-b361-ddbb25140ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.693285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee100f3-e0ed-4b9c-b361-ddbb25140ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.699577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b026d-4676-487f-9cac-438b82f2688b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.705211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67724c29-1798-43d0-ad0d-82b03553b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.707079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67724c29-1798-43d0-ad0d-82b03553b6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.707079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67724c29-1798-43d0-ad0d-82b03553b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.707079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67724c29-1798-43d0-ad0d-82b03553b6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.707341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67724c29-1798-43d0-ad0d-82b03553b6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:21.707446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67724c29-1798-43d0-ad0d-82b03553b6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.709199 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67724c29-1798-43d0-ad0d-82b03553b6b4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.723881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1300/2586] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:21.725204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67724c29-1798-43d0-ad0d-82b03553b6b4 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.738402 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67724c29-1798-43d0-ad0d-82b03553b6b4 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.743910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae83f7-bb52-4274-9e1d-168fa90eb61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.744551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae83f7-bb52-4274-9e1d-168fa90eb61e admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.744852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae83f7-bb52-4274-9e1d-168fa90eb61e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.745127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae83f7-bb52-4274-9e1d-168fa90eb61e admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.745774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae83f7-bb52-4274-9e1d-168fa90eb61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.747368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae83f7-bb52-4274-9e1d-168fa90eb61e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.760462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1301/2587] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:21.760462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae83f7-bb52-4274-9e1d-168fa90eb61e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.769576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee100f3-e0ed-4b9c-b361-ddbb25140ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.769576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:21.769576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee100f3-e0ed-4b9c-b361-ddbb25140ca3 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.774889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae83f7-bb52-4274-9e1d-168fa90eb61e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.778621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1287/2588] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:21.779355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee100f3-e0ed-4b9c-b361-ddbb25140ca3 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.780296 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5078b54-01ed-45c8-9023-0767299d88bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.781013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5078b54-01ed-45c8-9023-0767299d88bd admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.781295 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5078b54-01ed-45c8-9023-0767299d88bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.781587 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5078b54-01ed-45c8-9023-0767299d88bd admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.782200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5078b54-01ed-45c8-9023-0767299d88bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.784503 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5078b54-01ed-45c8-9023-0767299d88bd admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.791313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee100f3-e0ed-4b9c-b361-ddbb25140ca3 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.797450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380bf2b-da69-4e1f-9d2e-27e0ade371e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.798300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380bf2b-da69-4e1f-9d2e-27e0ade371e2 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.798580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380bf2b-da69-4e1f-9d2e-27e0ade371e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.798850 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380bf2b-da69-4e1f-9d2e-27e0ade371e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.799889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380bf2b-da69-4e1f-9d2e-27e0ade371e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.801949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380bf2b-da69-4e1f-9d2e-27e0ade371e2 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.816548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1288/2589] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:21.817615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380bf2b-da69-4e1f-9d2e-27e0ade371e2 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.828599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380bf2b-da69-4e1f-9d2e-27e0ade371e2 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.837809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c415b06-6cf2-42d0-a3e1-897024ca2703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.838554 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c415b06-6cf2-42d0-a3e1-897024ca2703 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.838936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c415b06-6cf2-42d0-a3e1-897024ca2703 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.839271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c415b06-6cf2-42d0-a3e1-897024ca2703 admin admin] PATH_INFO: `/v3/projects/6f16d44ecc794dcbb2107c7ff2cfd4a3/users/2785e3b388094120a96daf2e33db2da0/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.858415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c415b06-6cf2-42d0-a3e1-897024ca2703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f16d44ecc794dcbb2107c7ff2cfd4a3, user_id=2785e3b388094120a96daf2e33db2da0, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.862423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c415b06-6cf2-42d0-a3e1-897024ca2703 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.892552 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1302/2590] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:21.896988 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5078b54-01ed-45c8-9023-0767299d88bd admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.927600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:21.940667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1289/2591] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:21 2022] PUT /identity/v3/projects/6f16d44ecc794dcbb2107c7ff2cfd4a3/users/2785e3b388094120a96daf2e33db2da0/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:21.968720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5078b54-01ed-45c8-9023-0767299d88bd admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.009377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb76aa-32c1-4ed4-8eb0-5b771f16cafd None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.009952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb76aa-32c1-4ed4-8eb0-5b771f16cafd None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.009952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb76aa-32c1-4ed4-8eb0-5b771f16cafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.044113 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-65cb76aa-32c1-4ed4-8eb0-5b771f16cafd None None] MFA Rules not processed for user `2785e3b388094120a96daf2e33db2da0`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:22.046020 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-65cb76aa-32c1-4ed4-8eb0-5b771f16cafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:22.052139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505da02e-5290-4962-ae7e-944d578aacb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.052139 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505da02e-5290-4962-ae7e-944d578aacb4 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.052462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505da02e-5290-4962-ae7e-944d578aacb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.052462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505da02e-5290-4962-ae7e-944d578aacb4 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.053163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505da02e-5290-4962-ae7e-944d578aacb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.055291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505da02e-5290-4962-ae7e-944d578aacb4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.115242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1290/2592] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:22.129550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1303/2593] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:22.136158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505da02e-5290-4962-ae7e-944d578aacb4 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.141376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb76aa-32c1-4ed4-8eb0-5b771f16cafd None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.155352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb76aa-32c1-4ed4-8eb0-5b771f16cafd None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.160109 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953425f3-e1db-4617-a7d9-ae938d9dce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.160754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953425f3-e1db-4617-a7d9-ae938d9dce31 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.161027 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953425f3-e1db-4617-a7d9-ae938d9dce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.161566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953425f3-e1db-4617-a7d9-ae938d9dce31 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.162558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953425f3-e1db-4617-a7d9-ae938d9dce31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.164199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953425f3-e1db-4617-a7d9-ae938d9dce31 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.176261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1291/2594] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:22.180439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953425f3-e1db-4617-a7d9-ae938d9dce31 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.196595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953425f3-e1db-4617-a7d9-ae938d9dce31 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.205592 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505da02e-5290-4962-ae7e-944d578aacb4 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.210539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4bf4c-89f7-4c1f-b3d2-1f3e792c1915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.211165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4bf4c-89f7-4c1f-b3d2-1f3e792c1915 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.211450 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4bf4c-89f7-4c1f-b3d2-1f3e792c1915 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.211751 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4bf4c-89f7-4c1f-b3d2-1f3e792c1915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.213193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85892cee-c925-415e-bb85-e5498a73a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.213882 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85892cee-c925-415e-bb85-e5498a73a505 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.214158 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85892cee-c925-415e-bb85-e5498a73a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.214424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85892cee-c925-415e-bb85-e5498a73a505 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.215722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85892cee-c925-415e-bb85-e5498a73a505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.217484 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85892cee-c925-415e-bb85-e5498a73a505 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.224768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4bf4c-89f7-4c1f-b3d2-1f3e792c1915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.228435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4bf4c-89f7-4c1f-b3d2-1f3e792c1915 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.237334 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1304/2595] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:22.243543 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1292/2596] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:22.248211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4bf4c-89f7-4c1f-b3d2-1f3e792c1915 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.261101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4bf4c-89f7-4c1f-b3d2-1f3e792c1915 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.269085 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d99674-1dc4-4d4b-b65c-f50e3845d86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.274597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d99674-1dc4-4d4b-b65c-f50e3845d86d admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.274597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d99674-1dc4-4d4b-b65c-f50e3845d86d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.274597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d99674-1dc4-4d4b-b65c-f50e3845d86d admin admin] PATH_INFO: `/v3/projects/934ec3883ac841678edcdb0f004813b7/users/796f86d3ac834085b442a20cb3faf982/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.289140 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d99674-1dc4-4d4b-b65c-f50e3845d86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=934ec3883ac841678edcdb0f004813b7, user_id=796f86d3ac834085b442a20cb3faf982, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.292332 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d99674-1dc4-4d4b-b65c-f50e3845d86d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.388227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1305/2597] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:22 2022] PUT /identity/v3/projects/934ec3883ac841678edcdb0f004813b7/users/796f86d3ac834085b442a20cb3faf982/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:22.394324 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6138c-6127-459f-811e-2a1c7cc02427 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.394697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6138c-6127-459f-811e-2a1c7cc02427 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.395050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6138c-6127-459f-811e-2a1c7cc02427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.440924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-bac6138c-6127-459f-811e-2a1c7cc02427 None None] MFA Rules not processed for user `796f86d3ac834085b442a20cb3faf982`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:22.443130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bac6138c-6127-459f-811e-2a1c7cc02427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:22.500486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:22.522951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1293/2598] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:22.528283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d99674-1dc4-4d4b-b65c-f50e3845d86d admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.575606 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:22.596186 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d99674-1dc4-4d4b-b65c-f50e3845d86d admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.600904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a42b53-91c1-4f67-a3e7-e7c793040293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.601510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a42b53-91c1-4f67-a3e7-e7c793040293 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.601785 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a42b53-91c1-4f67-a3e7-e7c793040293 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.602054 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a42b53-91c1-4f67-a3e7-e7c793040293 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.602701 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a42b53-91c1-4f67-a3e7-e7c793040293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.604677 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a42b53-91c1-4f67-a3e7-e7c793040293 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.700953 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1306/2599] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:22 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:22.704864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6138c-6127-459f-811e-2a1c7cc02427 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.716234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6138c-6127-459f-811e-2a1c7cc02427 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.774773 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777257fb-b99c-4879-ba27-0d2bb4c205f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.775384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777257fb-b99c-4879-ba27-0d2bb4c205f4 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.775663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777257fb-b99c-4879-ba27-0d2bb4c205f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.775932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777257fb-b99c-4879-ba27-0d2bb4c205f4 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.776707 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777257fb-b99c-4879-ba27-0d2bb4c205f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.778610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777257fb-b99c-4879-ba27-0d2bb4c205f4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.907672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1294/2600] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:22 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:22.912629 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a42b53-91c1-4f67-a3e7-e7c793040293 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.953217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a42b53-91c1-4f67-a3e7-e7c793040293 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.953217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a9270-593b-4ade-81f9-74f53c31395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.953217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a9270-593b-4ade-81f9-74f53c31395e admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.953217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a9270-593b-4ade-81f9-74f53c31395e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.953610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a9270-593b-4ade-81f9-74f53c31395e admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.953610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a9270-593b-4ade-81f9-74f53c31395e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.953610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a9270-593b-4ade-81f9-74f53c31395e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.959304 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1307/2601] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:22.970410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777257fb-b99c-4879-ba27-0d2bb4c205f4 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.981686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777257fb-b99c-4879-ba27-0d2bb4c205f4 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.987820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fdfd3-fd9a-4d97-9718-6ec3c661259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.988690 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fdfd3-fd9a-4d97-9718-6ec3c661259d admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.988967 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fdfd3-fd9a-4d97-9718-6ec3c661259d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.989238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fdfd3-fd9a-4d97-9718-6ec3c661259d admin admin] PATH_INFO: `/v3/projects/ceecdce43bdc4b96abb52ea6eaeef0df/users/2e908d8ac75140f5804212a5fd80e9d3/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.012535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fdfd3-fd9a-4d97-9718-6ec3c661259d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceecdce43bdc4b96abb52ea6eaeef0df, user_id=2e908d8ac75140f5804212a5fd80e9d3, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.013293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fdfd3-fd9a-4d97-9718-6ec3c661259d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:23.091968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1295/2602] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:22 2022] PUT /identity/v3/projects/ceecdce43bdc4b96abb52ea6eaeef0df/users/2e908d8ac75140f5804212a5fd80e9d3/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:23.095791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a9270-593b-4ade-81f9-74f53c31395e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:23.107813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a9270-593b-4ade-81f9-74f53c31395e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:23.127770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fdfd3-fd9a-4d97-9718-6ec3c661259d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:23.129565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-176fdfd3-fd9a-4d97-9718-6ec3c661259d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:23.175938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d88b0c-6a80-4f1a-a8c3-600620d0c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:23.176884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d88b0c-6a80-4f1a-a8c3-600620d0c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.177401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d88b0c-6a80-4f1a-a8c3-600620d0c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.177636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d88b0c-6a80-4f1a-a8c3-600620d0c1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.178500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d88b0c-6a80-4f1a-a8c3-600620d0c1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.180144 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d88b0c-6a80-4f1a-a8c3-600620d0c1ec admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:23.192603 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fdfd3-fd9a-4d97-9718-6ec3c661259d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:23.193360 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1308/2603] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:23.197709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d88b0c-6a80-4f1a-a8c3-600620d0c1ec admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:23.198643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3510d-a205-4c3c-8df0-e59ca59efff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:23.199290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3510d-a205-4c3c-8df0-e59ca59efff5 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.199571 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3510d-a205-4c3c-8df0-e59ca59efff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.199870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3510d-a205-4c3c-8df0-e59ca59efff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.202586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fec3510d-a205-4c3c-8df0-e59ca59efff5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:23.209413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d88b0c-6a80-4f1a-a8c3-600620d0c1ec admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:23.214892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0399f-dcd0-4946-9e0f-1f343d3a22fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:23.215747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0399f-dcd0-4946-9e0f-1f343d3a22fb admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.216148 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0399f-dcd0-4946-9e0f-1f343d3a22fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.217223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0399f-dcd0-4946-9e0f-1f343d3a22fb admin admin] PATH_INFO: `/v3/projects/ceecdce43bdc4b96abb52ea6eaeef0df/users/2e908d8ac75140f5804212a5fd80e9d3/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.219314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0399f-dcd0-4946-9e0f-1f343d3a22fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceecdce43bdc4b96abb52ea6eaeef0df, user_id=2e908d8ac75140f5804212a5fd80e9d3, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.223902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0399f-dcd0-4946-9e0f-1f343d3a22fb admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:23.236376 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1309/2604] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:23 2022] PUT /identity/v3/projects/ceecdce43bdc4b96abb52ea6eaeef0df/users/2e908d8ac75140f5804212a5fd80e9d3/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:23.246973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ff550-2bc8-43b7-a4a8-9b53328e9d40 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.247258 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ff550-2bc8-43b7-a4a8-9b53328e9d40 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.247536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ff550-2bc8-43b7-a4a8-9b53328e9d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.270978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3510d-a205-4c3c-8df0-e59ca59efff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.272423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3510d-a205-4c3c-8df0-e59ca59efff5 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:23.276641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-de7ff550-2bc8-43b7-a4a8-9b53328e9d40 None None] MFA Rules not processed for user `2e908d8ac75140f5804212a5fd80e9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:23.277877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-de7ff550-2bc8-43b7-a4a8-9b53328e9d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:23.288719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1296/2605] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:23.352505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1310/2606] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:23.364530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3510d-a205-4c3c-8df0-e59ca59efff5 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:23.373191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3510d-a205-4c3c-8df0-e59ca59efff5 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:23.376854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:23.434636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8737049-a2f0-4ac7-bdc9-c2c91bbfe455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:23.435991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737049-a2f0-4ac7-bdc9-c2c91bbfe455 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.435991 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737049-a2f0-4ac7-bdc9-c2c91bbfe455 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.436225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8737049-a2f0-4ac7-bdc9-c2c91bbfe455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.446213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8737049-a2f0-4ac7-bdc9-c2c91bbfe455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.447663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8737049-a2f0-4ac7-bdc9-c2c91bbfe455 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:23.460646 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1297/2607] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:23.579782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ff550-2bc8-43b7-a4a8-9b53328e9d40 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:23.589930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ff550-2bc8-43b7-a4a8-9b53328e9d40 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:23.595170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fbd12-920f-4489-800c-c928e9d6c8f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:23.596127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbd12-920f-4489-800c-c928e9d6c8f8 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.596659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbd12-920f-4489-800c-c928e9d6c8f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.597021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fbd12-920f-4489-800c-c928e9d6c8f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.626317 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:23.668175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fbd12-920f-4489-800c-c928e9d6c8f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.670210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fbd12-920f-4489-800c-c928e9d6c8f8 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:23.679903 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1311/2608] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:26.950886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8737049-a2f0-4ac7-bdc9-c2c91bbfe455 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:27.024243 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8737049-a2f0-4ac7-bdc9-c2c91bbfe455 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:27.029493 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:27.030180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:27.032094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:27.032094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] PATH_INFO: `/v3/users/796f86d3ac834085b442a20cb3faf982` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:27.032094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796f86d3ac834085b442a20cb3faf982)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:27.034222 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:27.222532 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796f86d3ac834085b442a20cb3faf982'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:27.237414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796f86d3ac834085b442a20cb3faf982'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:27.351011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796f86d3ac834085b442a20cb3faf982'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:27.351404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796f86d3ac834085b442a20cb3faf982'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:27.360501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796f86d3ac834085b442a20cb3faf982'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:27.368017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1298/2609] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:26 2022] DELETE /identity/v3/users/796f86d3ac834085b442a20cb3faf982 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:27.375812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5846-df4b-4687-8262-fa6e74015768 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:27.376351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5846-df4b-4687-8262-fa6e74015768 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:27.376891 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5846-df4b-4687-8262-fa6e74015768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:27.402781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-9eae5846-df4b-4687-8262-fa6e74015768 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:27.403902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9eae5846-df4b-4687-8262-fa6e74015768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:27.474589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1312/2610] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:27.484889 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:27.486422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:27.523215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:27.551196 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6cac5-cb45-474a-9e88-e595c88e50f7 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:27.555623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caec382-0f1e-457e-bba1-d74bd7e36942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:27.564437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec382-0f1e-457e-bba1-d74bd7e36942 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:27.564437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec382-0f1e-457e-bba1-d74bd7e36942 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:27.564437 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec382-0f1e-457e-bba1-d74bd7e36942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:27.575351 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caec382-0f1e-457e-bba1-d74bd7e36942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:27.577772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caec382-0f1e-457e-bba1-d74bd7e36942 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:27.592151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1299/2611] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:28.187583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5846-df4b-4687-8262-fa6e74015768 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:28.199453 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9eae5846-df4b-4687-8262-fa6e74015768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:28.204406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5846-df4b-4687-8262-fa6e74015768 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:28.213625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:28.214314 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:28.214577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:28.214927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] PATH_INFO: `/v3/projects/934ec3883ac841678edcdb0f004813b7` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:28.216147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934ec3883ac841678edcdb0f004813b7)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:28.218206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:28.366520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934ec3883ac841678edcdb0f004813b7', 'request_id': 'req-fa99c668-5e58-4388-8312-8ecf3755c307'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:28.370710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caec382-0f1e-457e-bba1-d74bd7e36942 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:28.372219 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3caec382-0f1e-457e-bba1-d74bd7e36942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:28.381590 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934ec3883ac841678edcdb0f004813b7', 'request_id': 'req-fa99c668-5e58-4388-8312-8ecf3755c307'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:28.388374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934ec3883ac841678edcdb0f004813b7', 'request_id': 'req-fa99c668-5e58-4388-8312-8ecf3755c307'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:28.432962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caec382-0f1e-457e-bba1-d74bd7e36942 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:28.483796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] The token cache is being invalidate because project 934ec3883ac841678edcdb0f004813b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:28.484372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:28.485094 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:28.486702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1313/2612] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:28 2022] DELETE /identity/v3/projects/934ec3883ac841678edcdb0f004813b7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:28.488074 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e09cde-cfb0-4c02-86db-1383e5010066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:28.488721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e09cde-cfb0-4c02-86db-1383e5010066 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:28.488998 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e09cde-cfb0-4c02-86db-1383e5010066 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:28.489266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e09cde-cfb0-4c02-86db-1383e5010066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:28.490735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:28.491163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-02e09cde-cfb0-4c02-86db-1383e5010066 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:28.492224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:28.544051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:28.563578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e09cde-cfb0-4c02-86db-1383e5010066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:28.565118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e09cde-cfb0-4c02-86db-1383e5010066 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:28.570069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99c668-5e58-4388-8312-8ecf3755c307 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:28.574612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1300/2613] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:28.575009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:28.575709 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:28.575984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:28.576263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] PATH_INFO: `/v3/users/2e908d8ac75140f5804212a5fd80e9d3` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:28.577433 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e908d8ac75140f5804212a5fd80e9d3)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:28.579328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:28.852970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e908d8ac75140f5804212a5fd80e9d3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:28.860106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e908d8ac75140f5804212a5fd80e9d3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:28.956182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e908d8ac75140f5804212a5fd80e9d3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:28.956182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e908d8ac75140f5804212a5fd80e9d3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:28.956182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-a9e63d84-147d-488c-b325-4bf8a3efd236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e908d8ac75140f5804212a5fd80e9d3'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:28.979583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1314/2614] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:28 2022] DELETE /identity/v3/users/2e908d8ac75140f5804212a5fd80e9d3 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:29.478479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e09cde-cfb0-4c02-86db-1383e5010066 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:29.492453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e09cde-cfb0-4c02-86db-1383e5010066 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:29.563295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:29.589409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:29.589409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:29.589409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:29.589409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] PATH_INFO: `/v3/projects/ceecdce43bdc4b96abb52ea6eaeef0df` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:29.590014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceecdce43bdc4b96abb52ea6eaeef0df)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:29.590014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:29.753312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceecdce43bdc4b96abb52ea6eaeef0df', 'request_id': 'req-1d8b16a6-5583-4838-b4bc-dd364d6257ec'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:29.859492 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceecdce43bdc4b96abb52ea6eaeef0df', 'request_id': 'req-1d8b16a6-5583-4838-b4bc-dd364d6257ec'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:29.868660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceecdce43bdc4b96abb52ea6eaeef0df', 'request_id': 'req-1d8b16a6-5583-4838-b4bc-dd364d6257ec'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:29.880956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] The token cache is being invalidate because project ceecdce43bdc4b96abb52ea6eaeef0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:29.881341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:29.882098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-1d8b16a6-5583-4838-b4bc-dd364d6257ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:29.883940 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1301/2615] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:29 2022] DELETE /identity/v3/projects/ceecdce43bdc4b96abb52ea6eaeef0df => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:29.889498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694138-fa22-4cb5-9213-38132933cd30 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:29.889998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694138-fa22-4cb5-9213-38132933cd30 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:29.889998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da694138-fa22-4cb5-9213-38132933cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:29.911249 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-da694138-fa22-4cb5-9213-38132933cd30 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:29.912533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-da694138-fa22-4cb5-9213-38132933cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:29.984264 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1315/2616] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:29.993672 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b44574-8d19-47fd-8d05-f5c330d2c600 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:29.993998 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b44574-8d19-47fd-8d05-f5c330d2c600 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:29.994308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b44574-8d19-47fd-8d05-f5c330d2c600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:30.016828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-08b44574-8d19-47fd-8d05-f5c330d2c600 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:30.018242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-08b44574-8d19-47fd-8d05-f5c330d2c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:30.026786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1302/2617] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:30.032211 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da694138-fa22-4cb5-9213-38132933cd30 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:30.043106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da694138-fa22-4cb5-9213-38132933cd30 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:30.049358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97717c-9685-41aa-b7eb-a1ece71cacd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:30.050384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97717c-9685-41aa-b7eb-a1ece71cacd7 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:30.050848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97717c-9685-41aa-b7eb-a1ece71cacd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:30.051121 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97717c-9685-41aa-b7eb-a1ece71cacd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:30.051793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97717c-9685-41aa-b7eb-a1ece71cacd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:30.052181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97717c-9685-41aa-b7eb-a1ece71cacd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:30.053867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97717c-9685-41aa-b7eb-a1ece71cacd7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:30.067377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1316/2618] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:30.071901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b44574-8d19-47fd-8d05-f5c330d2c600 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:30.081679 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b44574-8d19-47fd-8d05-f5c330d2c600 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:30.087289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ff7f-521d-4378-8b96-623632577497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:30.087905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ff7f-521d-4378-8b96-623632577497 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:30.088193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ff7f-521d-4378-8b96-623632577497 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:30.088466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ff7f-521d-4378-8b96-623632577497 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:30.089141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01ff7f-521d-4378-8b96-623632577497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:30.091765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01ff7f-521d-4378-8b96-623632577497 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:30.193277 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1303/2619] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:30 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:30.197781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97717c-9685-41aa-b7eb-a1ece71cacd7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:30.209019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97717c-9685-41aa-b7eb-a1ece71cacd7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:30.266501 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:30.278596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5206250-b0fd-4569-8e15-6d07ac1a90db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:30.279215 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5206250-b0fd-4569-8e15-6d07ac1a90db admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:30.279492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5206250-b0fd-4569-8e15-6d07ac1a90db admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:30.279766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5206250-b0fd-4569-8e15-6d07ac1a90db admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:30.280406 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5206250-b0fd-4569-8e15-6d07ac1a90db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:30.282395 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5206250-b0fd-4569-8e15-6d07ac1a90db admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:30.402766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1317/2620] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:30 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:30.406801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ff7f-521d-4378-8b96-623632577497 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:30.418420 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ff7f-521d-4378-8b96-623632577497 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:30.423350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eba16-adf0-4003-bc6b-f05c8ff7127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:30.423965 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eba16-adf0-4003-bc6b-f05c8ff7127f admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:30.424239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eba16-adf0-4003-bc6b-f05c8ff7127f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:30.424633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1eba16-adf0-4003-bc6b-f05c8ff7127f admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:30.425207 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eba16-adf0-4003-bc6b-f05c8ff7127f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:30.426824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1eba16-adf0-4003-bc6b-f05c8ff7127f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:30.438928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1304/2621] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:30.442952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5206250-b0fd-4569-8e15-6d07ac1a90db admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:30.455516 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5206250-b0fd-4569-8e15-6d07ac1a90db admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:30.460100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310eaae-9360-4c3e-85e3-abb2408d18a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:30.460786 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310eaae-9360-4c3e-85e3-abb2408d18a1 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:30.461474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310eaae-9360-4c3e-85e3-abb2408d18a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:30.461820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310eaae-9360-4c3e-85e3-abb2408d18a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:30.462583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310eaae-9360-4c3e-85e3-abb2408d18a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:30.464286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310eaae-9360-4c3e-85e3-abb2408d18a1 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:30.476822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1318/2622] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:30.482238 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eba16-adf0-4003-bc6b-f05c8ff7127f admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:30.493136 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1eba16-adf0-4003-bc6b-f05c8ff7127f admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:30.502113 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a5c15-ef77-411d-92b8-a2f6ab584d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:30.502817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a5c15-ef77-411d-92b8-a2f6ab584d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:30.503134 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a5c15-ef77-411d-92b8-a2f6ab584d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:30.503407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a5c15-ef77-411d-92b8-a2f6ab584d2a admin admin] PATH_INFO: `/v3/projects/235e1a82873042ff8173cc50352090a5/users/998754b5c6b34754a6ec445403185c57/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:30.521916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a5c15-ef77-411d-92b8-a2f6ab584d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=235e1a82873042ff8173cc50352090a5, user_id=998754b5c6b34754a6ec445403185c57, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:30.524866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a5c15-ef77-411d-92b8-a2f6ab584d2a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:30.631291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1305/2623] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:30 2022] PUT /identity/v3/projects/235e1a82873042ff8173cc50352090a5/users/998754b5c6b34754a6ec445403185c57/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:30.641454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093ab56-ccb1-456f-b724-98f3c2e4bda6 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:30.641799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093ab56-ccb1-456f-b724-98f3c2e4bda6 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:30.642000 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093ab56-ccb1-456f-b724-98f3c2e4bda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:30.677705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-d093ab56-ccb1-456f-b724-98f3c2e4bda6 None None] MFA Rules not processed for user `998754b5c6b34754a6ec445403185c57`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:30.679230 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d093ab56-ccb1-456f-b724-98f3c2e4bda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:30.750624 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1319/2624] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:30.755431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a5c15-ef77-411d-92b8-a2f6ab584d2a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:30.829114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a5c15-ef77-411d-92b8-a2f6ab584d2a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:30.834058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f02b7-5aa3-448d-b12d-ca8e982aa03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:30.834875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f02b7-5aa3-448d-b12d-ca8e982aa03d admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:30.835303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f02b7-5aa3-448d-b12d-ca8e982aa03d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:30.836077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f02b7-5aa3-448d-b12d-ca8e982aa03d admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:30.836201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f02b7-5aa3-448d-b12d-ca8e982aa03d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:30.838133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f02b7-5aa3-448d-b12d-ca8e982aa03d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:30.854517 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:30.974685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1306/2625] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:30 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:30.979171 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093ab56-ccb1-456f-b724-98f3c2e4bda6 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:30.993244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093ab56-ccb1-456f-b724-98f3c2e4bda6 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:31.040697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f02b7-5aa3-448d-b12d-ca8e982aa03d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:31.047968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-937f02b7-5aa3-448d-b12d-ca8e982aa03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:31.068842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672d576-04e2-452d-9cbb-3d93d34dd1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:31.070901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d576-04e2-452d-9cbb-3d93d34dd1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:31.070901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d576-04e2-452d-9cbb-3d93d34dd1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:31.070901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d576-04e2-452d-9cbb-3d93d34dd1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:31.070901 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672d576-04e2-452d-9cbb-3d93d34dd1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:31.072804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672d576-04e2-452d-9cbb-3d93d34dd1c0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:31.114221 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f02b7-5aa3-448d-b12d-ca8e982aa03d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:31.118464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cf2bc-21fa-4b7d-bbdc-cf496bac328f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:31.119098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cf2bc-21fa-4b7d-bbdc-cf496bac328f service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:31.119388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cf2bc-21fa-4b7d-bbdc-cf496bac328f service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:31.119660 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cf2bc-21fa-4b7d-bbdc-cf496bac328f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:31.121507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bc3cf2bc-21fa-4b7d-bbdc-cf496bac328f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:31.134883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cf2bc-21fa-4b7d-bbdc-cf496bac328f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:31.136374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cf2bc-21fa-4b7d-bbdc-cf496bac328f service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:31.140868 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1320/2626] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:30 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:31.145093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672d576-04e2-452d-9cbb-3d93d34dd1c0 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:31.148924 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1307/2627] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:31.155699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672d576-04e2-452d-9cbb-3d93d34dd1c0 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:31.160426 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d23468-ca16-42f6-bf42-f543f81ef181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:31.161079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d23468-ca16-42f6-bf42-f543f81ef181 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:31.161358 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d23468-ca16-42f6-bf42-f543f81ef181 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:31.161637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d23468-ca16-42f6-bf42-f543f81ef181 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:31.162287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d23468-ca16-42f6-bf42-f543f81ef181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:31.163899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d23468-ca16-42f6-bf42-f543f81ef181 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:31.175160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1321/2628] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:31.181809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cf2bc-21fa-4b7d-bbdc-cf496bac328f service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:31.201057 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cf2bc-21fa-4b7d-bbdc-cf496bac328f service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:31.208433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874143d6-13da-4fd9-b1f4-22ee7c9538a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:31.209722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874143d6-13da-4fd9-b1f4-22ee7c9538a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:31.210288 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874143d6-13da-4fd9-b1f4-22ee7c9538a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:31.210843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874143d6-13da-4fd9-b1f4-22ee7c9538a5 admin admin] PATH_INFO: `/v3/projects/72d1096087474b85a75c184148175322/users/51db62e83b7845778fbb2e4319ddeb07/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:31.241312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874143d6-13da-4fd9-b1f4-22ee7c9538a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d1096087474b85a75c184148175322, user_id=51db62e83b7845778fbb2e4319ddeb07, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:31.246879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874143d6-13da-4fd9-b1f4-22ee7c9538a5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:31.351938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1308/2629] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:31 2022] PUT /identity/v3/projects/72d1096087474b85a75c184148175322/users/51db62e83b7845778fbb2e4319ddeb07/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:31.357031 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d23468-ca16-42f6-bf42-f543f81ef181 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:31.368246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d23468-ca16-42f6-bf42-f543f81ef181 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:31.409655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:31.437887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7c0a-50ae-4139-99db-f7c2537a0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:31.438519 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7c0a-50ae-4139-99db-f7c2537a0c6b admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:31.438793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7c0a-50ae-4139-99db-f7c2537a0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:31.439062 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7c0a-50ae-4139-99db-f7c2537a0c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:31.439710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7c0a-50ae-4139-99db-f7c2537a0c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:31.441545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7c0a-50ae-4139-99db-f7c2537a0c6b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:31.453256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1322/2630] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:31.458413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874143d6-13da-4fd9-b1f4-22ee7c9538a5 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:31.470608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874143d6-13da-4fd9-b1f4-22ee7c9538a5 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:31.475741 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a11342-cdc6-4c8c-889a-2a20833fb643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:31.476418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11342-cdc6-4c8c-889a-2a20833fb643 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:31.476726 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11342-cdc6-4c8c-889a-2a20833fb643 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:31.476986 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a11342-cdc6-4c8c-889a-2a20833fb643 admin admin] PATH_INFO: `/v3/projects/72d1096087474b85a75c184148175322/users/51db62e83b7845778fbb2e4319ddeb07/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:31.478932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a11342-cdc6-4c8c-889a-2a20833fb643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d1096087474b85a75c184148175322, user_id=51db62e83b7845778fbb2e4319ddeb07, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:31.482570 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a11342-cdc6-4c8c-889a-2a20833fb643 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:31.494810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1309/2631] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:31 2022] PUT /identity/v3/projects/72d1096087474b85a75c184148175322/users/51db62e83b7845778fbb2e4319ddeb07/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:31.506638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761cc64-0a18-45e4-8cfc-f910443db79a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:31.506913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761cc64-0a18-45e4-8cfc-f910443db79a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:31.507185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761cc64-0a18-45e4-8cfc-f910443db79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:31.538417 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3761cc64-0a18-45e4-8cfc-f910443db79a None None] MFA Rules not processed for user `51db62e83b7845778fbb2e4319ddeb07`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:31.539841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3761cc64-0a18-45e4-8cfc-f910443db79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:31.616468 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1323/2632] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:31.628190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a11342-cdc6-4c8c-889a-2a20833fb643 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:31.630046 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-d9a11342-cdc6-4c8c-889a-2a20833fb643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:31.691055 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a11342-cdc6-4c8c-889a-2a20833fb643 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:31.695294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb333b58-802c-4873-9e99-6fbed2d274a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:31.695909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb333b58-802c-4873-9e99-6fbed2d274a2 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:31.696182 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb333b58-802c-4873-9e99-6fbed2d274a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:31.696455 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb333b58-802c-4873-9e99-6fbed2d274a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:31.709244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb333b58-802c-4873-9e99-6fbed2d274a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:31.710736 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb333b58-802c-4873-9e99-6fbed2d274a2 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:31.721831 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1310/2633] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:32.879609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761cc64-0a18-45e4-8cfc-f910443db79a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:32.951613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761cc64-0a18-45e4-8cfc-f910443db79a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:32.958806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:32.959462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:32.959757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:32.960019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] PATH_INFO: `/v3/users/998754b5c6b34754a6ec445403185c57` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:32.961545 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] RBAC: Authorizing `identity:delete_user(user_id=998754b5c6b34754a6ec445403185c57)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:32.963597 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:33.192738 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998754b5c6b34754a6ec445403185c57'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.199995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998754b5c6b34754a6ec445403185c57'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.203266 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:33.289453 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998754b5c6b34754a6ec445403185c57'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.290608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998754b5c6b34754a6ec445403185c57'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.293063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998754b5c6b34754a6ec445403185c57'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.337447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1324/2634] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:32 2022] DELETE /identity/v3/users/998754b5c6b34754a6ec445403185c57 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:33.344332 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbba13-9aea-4fa7-be6c-7b8ce79b3c8c None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:33.344874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbba13-9aea-4fa7-be6c-7b8ce79b3c8c None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:33.345413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbba13-9aea-4fa7-be6c-7b8ce79b3c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:33.382957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-dbbbba13-9aea-4fa7-be6c-7b8ce79b3c8c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:33.385151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-dbbbba13-9aea-4fa7-be6c-7b8ce79b3c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:33.402177 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:33.404539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:33.483078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1311/2635] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:33.493905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbba13-9aea-4fa7-be6c-7b8ce79b3c8c None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:33.496063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-dbbbba13-9aea-4fa7-be6c-7b8ce79b3c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:33.504638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:33.515174 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc960aa5-25d3-4e06-a9e2-d7a5f899cbef admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:33.522651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:33.524108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:33.524584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:33.525319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] PATH_INFO: `/v3/users/0eacdae742354b6fb6b48127da614f77` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:33.527389 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eacdae742354b6fb6b48127da614f77)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:33.530839 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:33.579988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbba13-9aea-4fa7-be6c-7b8ce79b3c8c None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:33.584565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c2ec8-0819-4af2-9d18-064f6ac29f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:33.585855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c2ec8-0819-4af2-9d18-064f6ac29f82 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:33.585855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c2ec8-0819-4af2-9d18-064f6ac29f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:33.585855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c2ec8-0819-4af2-9d18-064f6ac29f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:33.596082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c2ec8-0819-4af2-9d18-064f6ac29f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:33.598013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c2ec8-0819-4af2-9d18-064f6ac29f82 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:33.614858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1312/2636] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:33.736281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eacdae742354b6fb6b48127da614f77'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.743811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eacdae742354b6fb6b48127da614f77'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.848952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eacdae742354b6fb6b48127da614f77'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.849726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eacdae742354b6fb6b48127da614f77'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.850447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eacdae742354b6fb6b48127da614f77'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.886785 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1325/2637] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:33 2022] DELETE /identity/v3/users/0eacdae742354b6fb6b48127da614f77 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:33.891933 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5e8e5-dc2a-4175-be4d-58a04369a2c4 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:33.892873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5e8e5-dc2a-4175-be4d-58a04369a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:33.892873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5e8e5-dc2a-4175-be4d-58a04369a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:33.927303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-5ea5e8e5-dc2a-4175-be4d-58a04369a2c4 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:33.928456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5ea5e8e5-dc2a-4175-be4d-58a04369a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:34.035546 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1313/2638] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:34.043492 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:34.045449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:34.117204 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec73b-8c53-489a-9b8d-fadb463fec06 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:34.121703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255924d-0cf0-49bd-bf8c-5a094b4e20fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:34.125755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255924d-0cf0-49bd-bf8c-5a094b4e20fb service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:34.125755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255924d-0cf0-49bd-bf8c-5a094b4e20fb service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:34.125755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255924d-0cf0-49bd-bf8c-5a094b4e20fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:34.131227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5e8e5-dc2a-4175-be4d-58a04369a2c4 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:34.133584 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5ea5e8e5-dc2a-4175-be4d-58a04369a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:34.151534 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5e8e5-dc2a-4175-be4d-58a04369a2c4 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:34.153446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255924d-0cf0-49bd-bf8c-5a094b4e20fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:34.159848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255924d-0cf0-49bd-bf8c-5a094b4e20fb service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:34.160164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:34.160164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:34.160164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:34.160164 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] PATH_INFO: `/v3/projects/235e1a82873042ff8173cc50352090a5` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:34.161118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=235e1a82873042ff8173cc50352090a5)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:34.164092 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:34.169141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:34.183375 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1326/2639] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:34.347625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235e1a82873042ff8173cc50352090a5', 'request_id': 'req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.390846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255924d-0cf0-49bd-bf8c-5a094b4e20fb service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:34.393876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3255924d-0cf0-49bd-bf8c-5a094b4e20fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:34.413637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255924d-0cf0-49bd-bf8c-5a094b4e20fb service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:34.428500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235e1a82873042ff8173cc50352090a5', 'request_id': 'req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.435844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235e1a82873042ff8173cc50352090a5', 'request_id': 'req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.456461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] The token cache is being invalidate because project 235e1a82873042ff8173cc50352090a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:34.456833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.457531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.459751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1314/2640] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:34 2022] DELETE /identity/v3/projects/235e1a82873042ff8173cc50352090a5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:34.463873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:34.468489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:34.520414 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:34.521108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:34.521390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:34.521662 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] PATH_INFO: `/v3/users/2785e3b388094120a96daf2e33db2da0` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:34.523067 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2785e3b388094120a96daf2e33db2da0)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:34.525275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:34.525754 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:34.576869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cba10-5e5b-40bd-9ae9-c5a6c5cc14d1 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:34.589647 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:34.590180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:34.590459 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:34.590771 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] PATH_INFO: `/v3/users/51db62e83b7845778fbb2e4319ddeb07` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:34.592180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51db62e83b7845778fbb2e4319ddeb07)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:34.594293 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:34.819106 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2785e3b388094120a96daf2e33db2da0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.833564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2785e3b388094120a96daf2e33db2da0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.872864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51db62e83b7845778fbb2e4319ddeb07'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.891275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51db62e83b7845778fbb2e4319ddeb07'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.922982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2785e3b388094120a96daf2e33db2da0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.924256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2785e3b388094120a96daf2e33db2da0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.925141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2785e3b388094120a96daf2e33db2da0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.955755 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1327/2641] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:34 2022] DELETE /identity/v3/users/2785e3b388094120a96daf2e33db2da0 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:34.956764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:34.961296 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:35.014783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51db62e83b7845778fbb2e4319ddeb07'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.015750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51db62e83b7845778fbb2e4319ddeb07'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.031206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-250da893-7a15-4f68-9b3b-37bfb8dffb5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51db62e83b7845778fbb2e4319ddeb07'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.041363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1315/2642] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:34 2022] DELETE /identity/v3/users/51db62e83b7845778fbb2e4319ddeb07 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:35.042825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4f1ed-ec4c-4655-a844-ee0c04ad4d47 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:35.043108 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4f1ed-ec4c-4655-a844-ee0c04ad4d47 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:35.043373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4f1ed-ec4c-4655-a844-ee0c04ad4d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:35.048784 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca1a4f-c0fd-426b-9412-2fb5f791b8bf admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:35.069216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-fac4f1ed-ec4c-4655-a844-ee0c04ad4d47 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:35.070485 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fac4f1ed-ec4c-4655-a844-ee0c04ad4d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:35.075519 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:35.140320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:35.140320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:35.140320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:35.140320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] PATH_INFO: `/v3/projects/ddec1e01a3cd43568c9784fe18b3863d` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:35.141071 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddec1e01a3cd43568c9784fe18b3863d)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:35.143581 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:35.220147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1316/2643] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:35.243904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4f1ed-ec4c-4655-a844-ee0c04ad4d47 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:35.243904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-fac4f1ed-ec4c-4655-a844-ee0c04ad4d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:35.305502 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:35.311610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4f1ed-ec4c-4655-a844-ee0c04ad4d47 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:35.319267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddec1e01a3cd43568c9784fe18b3863d', 'request_id': 'req-960593c1-e730-4435-801d-0dec32ca03e6'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.341354 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddec1e01a3cd43568c9784fe18b3863d', 'request_id': 'req-960593c1-e730-4435-801d-0dec32ca03e6'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.356555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddec1e01a3cd43568c9784fe18b3863d', 'request_id': 'req-960593c1-e730-4435-801d-0dec32ca03e6'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.377182 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11eb37-0552-4d2c-a495-cbc04a0082dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:35.377801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11eb37-0552-4d2c-a495-cbc04a0082dc service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:35.378075 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11eb37-0552-4d2c-a495-cbc04a0082dc service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:35.378345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11eb37-0552-4d2c-a495-cbc04a0082dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:35.454421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11eb37-0552-4d2c-a495-cbc04a0082dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:35.456036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11eb37-0552-4d2c-a495-cbc04a0082dc service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:35.466975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1317/2644] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:35.486446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] The token cache is being invalidate because project ddec1e01a3cd43568c9784fe18b3863d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:35.486710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.487563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.489193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1328/2645] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:34 2022] DELETE /identity/v3/projects/ddec1e01a3cd43568c9784fe18b3863d => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:35.493637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11eb37-0552-4d2c-a495-cbc04a0082dc service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:35.495199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0a11eb37-0552-4d2c-a495-cbc04a0082dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:35.511612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11eb37-0552-4d2c-a495-cbc04a0082dc service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:35.517869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:35.518598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:35.518944 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:35.519224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] PATH_INFO: `/v3/users/7746e72312ea473ebdc4b5a82336fb55` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:35.520671 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7746e72312ea473ebdc4b5a82336fb55)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:35.522397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:35.561915 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:35.566538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:35.581921 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960593c1-e730-4435-801d-0dec32ca03e6 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:35.587286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:35.588012 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:35.588360 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:35.588698 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] PATH_INFO: `/v3/users/511ddb50fc25452fac22ed8396542f96` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:35.589845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=511ddb50fc25452fac22ed8396542f96)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:35.592294 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:35.806826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7746e72312ea473ebdc4b5a82336fb55'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.821112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7746e72312ea473ebdc4b5a82336fb55'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.863335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511ddb50fc25452fac22ed8396542f96'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.871175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511ddb50fc25452fac22ed8396542f96'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.910689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7746e72312ea473ebdc4b5a82336fb55'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.911290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7746e72312ea473ebdc4b5a82336fb55'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.918936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7746e72312ea473ebdc4b5a82336fb55'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.925326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1318/2646] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:35 2022] DELETE /identity/v3/users/7746e72312ea473ebdc4b5a82336fb55 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:35.926204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:35.927695 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:35.995963 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0babe-65e2-4724-ba26-86438c286f28 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:36.005355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:36.005355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:36.005355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:36.005355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] PATH_INFO: `/v3/projects/72d1096087474b85a75c184148175322` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:36.006339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d1096087474b85a75c184148175322)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:36.006339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:36.031385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511ddb50fc25452fac22ed8396542f96'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.032051 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511ddb50fc25452fac22ed8396542f96'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.032707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511ddb50fc25452fac22ed8396542f96'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.055647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1329/2647] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:35 2022] DELETE /identity/v3/users/511ddb50fc25452fac22ed8396542f96 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:36.057000 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:36.058625 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:36.157828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d1096087474b85a75c184148175322', 'request_id': 'req-0c6de735-247a-4029-829a-c5f55080523b'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.165222 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb44c4-ef24-4c42-acd5-7e2c02e2c822 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:36.230683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:36.231516 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:36.231828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:36.232100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] PATH_INFO: `/v3/projects/6f16d44ecc794dcbb2107c7ff2cfd4a3` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:36.233355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f16d44ecc794dcbb2107c7ff2cfd4a3)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:36.235312 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:36.248610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d1096087474b85a75c184148175322', 'request_id': 'req-0c6de735-247a-4029-829a-c5f55080523b'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.259668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d1096087474b85a75c184148175322', 'request_id': 'req-0c6de735-247a-4029-829a-c5f55080523b'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.276848 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] The token cache is being invalidate because project 72d1096087474b85a75c184148175322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:36.277357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.278461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-0c6de735-247a-4029-829a-c5f55080523b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.281139 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1319/2648] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:35 2022] DELETE /identity/v3/projects/72d1096087474b85a75c184148175322 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:36.293427 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9c38a-2f12-438f-a99e-6c1fc7b4bd89 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:36.293885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9c38a-2f12-438f-a99e-6c1fc7b4bd89 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:36.294703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9c38a-2f12-438f-a99e-6c1fc7b4bd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:36.335048 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-85c9c38a-2f12-438f-a99e-6c1fc7b4bd89 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:36.336694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-85c9c38a-2f12-438f-a99e-6c1fc7b4bd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:36.348555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1320/2649] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:36.358217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f16d44ecc794dcbb2107c7ff2cfd4a3', 'request_id': 'req-7f039973-e1c2-4051-b81e-37bc48dbadb0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.361175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dba8c-bc21-4228-b00e-206aefcf2906 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:36.361742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dba8c-bc21-4228-b00e-206aefcf2906 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:36.362101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dba8c-bc21-4228-b00e-206aefcf2906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:36.366102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f16d44ecc794dcbb2107c7ff2cfd4a3', 'request_id': 'req-7f039973-e1c2-4051-b81e-37bc48dbadb0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.373649 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f16d44ecc794dcbb2107c7ff2cfd4a3', 'request_id': 'req-7f039973-e1c2-4051-b81e-37bc48dbadb0'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.395443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-df9dba8c-bc21-4228-b00e-206aefcf2906 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:36.400444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-df9dba8c-bc21-4228-b00e-206aefcf2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:36.457773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] The token cache is being invalidate because project 6f16d44ecc794dcbb2107c7ff2cfd4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:36.457773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.458550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.461803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1330/2650] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:36 2022] DELETE /identity/v3/projects/6f16d44ecc794dcbb2107c7ff2cfd4a3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:36.462819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:36.464506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:36.503360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1321/2651] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:36.508398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dba8c-bc21-4228-b00e-206aefcf2906 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:36.526705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dba8c-bc21-4228-b00e-206aefcf2906 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:36.534423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefb147-d741-48cb-8ef0-af007a080c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:36.538230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefb147-d741-48cb-8ef0-af007a080c58 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:36.538230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefb147-d741-48cb-8ef0-af007a080c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:36.538230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefb147-d741-48cb-8ef0-af007a080c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:36.538230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefb147-d741-48cb-8ef0-af007a080c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:36.539160 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefb147-d741-48cb-8ef0-af007a080c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:36.542524 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefb147-d741-48cb-8ef0-af007a080c58 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:36.591295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1322/2652] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:04:36.591295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefb147-d741-48cb-8ef0-af007a080c58 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:36.596793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-6fefb147-d741-48cb-8ef0-af007a080c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:36.601725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f039973-e1c2-4051-b81e-37bc48dbadb0 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:36.611639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:36.612341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:36.612671 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:36.612948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] PATH_INFO: `/v3/projects/f980c394796743c19e9c36b8c0c0e544` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:36.614705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f980c394796743c19e9c36b8c0c0e544)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:36.616874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:36.627952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefb147-d741-48cb-8ef0-af007a080c58 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:36.636486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:36.637685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:36.638061 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:36.638489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] PATH_INFO: `/v3/projects/58062eb043404b779fe07df1a91edd54` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:36.640446 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58062eb043404b779fe07df1a91edd54)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:36.646298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:36.751378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f980c394796743c19e9c36b8c0c0e544', 'request_id': 'req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.758936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f980c394796743c19e9c36b8c0c0e544', 'request_id': 'req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.767422 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f980c394796743c19e9c36b8c0c0e544', 'request_id': 'req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.773830 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:36.795405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58062eb043404b779fe07df1a91edd54', 'request_id': 'req-7cd184eb-93b5-46f9-9034-2cf94324d92c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.961992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58062eb043404b779fe07df1a91edd54', 'request_id': 'req-7cd184eb-93b5-46f9-9034-2cf94324d92c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.969952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58062eb043404b779fe07df1a91edd54', 'request_id': 'req-7cd184eb-93b5-46f9-9034-2cf94324d92c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.980934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] The token cache is being invalidate because project 58062eb043404b779fe07df1a91edd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:36.981737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.982496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:36.984041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1323/2653] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:36 2022] DELETE /identity/v3/projects/58062eb043404b779fe07df1a91edd54 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:36.984909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:36.986204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:37.030315 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] The token cache is being invalidate because project f980c394796743c19e9c36b8c0c0e544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:37.030606 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:37.031355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:37.032908 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1331/2654] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:36 2022] DELETE /identity/v3/projects/f980c394796743c19e9c36b8c0c0e544 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:37.033667 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.034948 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:37.053906 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd184eb-93b5-46f9-9034-2cf94324d92c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.059073 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23582d8b-af90-4b34-8c40-fecc3cf0c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.059779 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582d8b-af90-4b34-8c40-fecc3cf0c03f admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.060312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582d8b-af90-4b34-8c40-fecc3cf0c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.060746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582d8b-af90-4b34-8c40-fecc3cf0c03f admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.061445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23582d8b-af90-4b34-8c40-fecc3cf0c03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.063544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23582d8b-af90-4b34-8c40-fecc3cf0c03f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:37.099922 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d35b34-1bb2-4894-9699-f0f5ac802fc7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.104538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.105179 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.105454 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.105724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] PATH_INFO: `/v3/users/2544c56b1e0849b2866e08b3fcbae4ee` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.107366 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2544c56b1e0849b2866e08b3fcbae4ee)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.109359 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:37.163531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1324/2655] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:36 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:37.164893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed049ef-aca9-41cd-a3d4-a258c9e0805e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.165170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed049ef-aca9-41cd-a3d4-a258c9e0805e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.165447 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed049ef-aca9-41cd-a3d4-a258c9e0805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.185811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:37.188156 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-5ed049ef-aca9-41cd-a3d4-a258c9e0805e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:37.189412 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5ed049ef-aca9-41cd-a3d4-a258c9e0805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:37.262059 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1325/2656] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:37.262921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed049ef-aca9-41cd-a3d4-a258c9e0805e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.264298 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5ed049ef-aca9-41cd-a3d4-a258c9e0805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:37.276955 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed049ef-aca9-41cd-a3d4-a258c9e0805e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.282500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31621ada-aa06-440f-b76e-d3f777a2505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.283123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621ada-aa06-440f-b76e-d3f777a2505c admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.283407 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621ada-aa06-440f-b76e-d3f777a2505c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.283681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621ada-aa06-440f-b76e-d3f777a2505c admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.284314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31621ada-aa06-440f-b76e-d3f777a2505c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.286313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31621ada-aa06-440f-b76e-d3f777a2505c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:37.353665 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2544c56b1e0849b2866e08b3fcbae4ee'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:37.361522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2544c56b1e0849b2866e08b3fcbae4ee'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:37.379863 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1326/2657] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:37 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:37.381265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b5dc-31dd-4b83-8f5b-36cccc63972a None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.384051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b5dc-31dd-4b83-8f5b-36cccc63972a None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.384051 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5b5dc-31dd-4b83-8f5b-36cccc63972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.402111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-54d5b5dc-31dd-4b83-8f5b-36cccc63972a None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:37.403950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-54d5b5dc-31dd-4b83-8f5b-36cccc63972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:37.412598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1327/2658] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:37.413974 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b5dc-31dd-4b83-8f5b-36cccc63972a None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.425527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5b5dc-31dd-4b83-8f5b-36cccc63972a None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.430674 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0081475-2ca2-4edd-86ef-dec75f8db987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.431281 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0081475-2ca2-4edd-86ef-dec75f8db987 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.431555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0081475-2ca2-4edd-86ef-dec75f8db987 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.431824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0081475-2ca2-4edd-86ef-dec75f8db987 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.432454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0081475-2ca2-4edd-86ef-dec75f8db987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.434071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0081475-2ca2-4edd-86ef-dec75f8db987 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:37.441962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2544c56b1e0849b2866e08b3fcbae4ee'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:37.442804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2544c56b1e0849b2866e08b3fcbae4ee'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:37.443500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2544c56b1e0849b2866e08b3fcbae4ee'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:37.446063 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1328/2659] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:37.447145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0081475-2ca2-4edd-86ef-dec75f8db987 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.449665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-e0081475-2ca2-4edd-86ef-dec75f8db987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:37.463943 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1332/2660] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:37 2022] DELETE /identity/v3/users/2544c56b1e0849b2866e08b3fcbae4ee => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:37.464838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.466890 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:37.470439 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0081475-2ca2-4edd-86ef-dec75f8db987 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.560473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372e7d7-5a84-410e-b719-6b17d4f78b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.561148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372e7d7-5a84-410e-b719-6b17d4f78b02 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.561567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372e7d7-5a84-410e-b719-6b17d4f78b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.561858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372e7d7-5a84-410e-b719-6b17d4f78b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.562905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372e7d7-5a84-410e-b719-6b17d4f78b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:37.563215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372e7d7-5a84-410e-b719-6b17d4f78b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.564957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372e7d7-5a84-410e-b719-6b17d4f78b02 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:37.567703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372257a-650c-4ecb-ab1d-35800c283db2 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.573224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac03c1-767c-4c49-b7af-9837629ddde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.574405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac03c1-767c-4c49-b7af-9837629ddde7 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.574405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac03c1-767c-4c49-b7af-9837629ddde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.574405 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac03c1-767c-4c49-b7af-9837629ddde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.575763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac03c1-767c-4c49-b7af-9837629ddde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.577434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac03c1-767c-4c49-b7af-9837629ddde7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:37.581880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1329/2661] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:37.587118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372e7d7-5a84-410e-b719-6b17d4f78b02 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.593975 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1333/2662] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:37.598143 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac03c1-767c-4c49-b7af-9837629ddde7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.598768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372e7d7-5a84-410e-b719-6b17d4f78b02 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.603999 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159561f7-a79d-407d-9bc1-8c91c5e211f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.604740 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159561f7-a79d-407d-9bc1-8c91c5e211f7 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.605018 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159561f7-a79d-407d-9bc1-8c91c5e211f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.605291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159561f7-a79d-407d-9bc1-8c91c5e211f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.605917 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159561f7-a79d-407d-9bc1-8c91c5e211f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.607936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159561f7-a79d-407d-9bc1-8c91c5e211f7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:37.608669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac03c1-767c-4c49-b7af-9837629ddde7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.613923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbe1db-8f52-46f9-99d7-d47715f64ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.614595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbe1db-8f52-46f9-99d7-d47715f64ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.614873 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbe1db-8f52-46f9-99d7-d47715f64ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.615143 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbe1db-8f52-46f9-99d7-d47715f64ea5 admin admin] PATH_INFO: `/v3/projects/a164913768fc48349b5951d4997318fb/users/d954426082884655a74bfda0b985045d/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.631864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbe1db-8f52-46f9-99d7-d47715f64ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a164913768fc48349b5951d4997318fb, user_id=d954426082884655a74bfda0b985045d, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.634565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbe1db-8f52-46f9-99d7-d47715f64ea5 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:37.730868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1330/2663] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:37 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:37.730868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159561f7-a79d-407d-9bc1-8c91c5e211f7 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.755533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1334/2664] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:37 2022] PUT /identity/v3/projects/a164913768fc48349b5951d4997318fb/users/d954426082884655a74bfda0b985045d/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:37.766936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b91d8-6db7-4110-8336-e4fd97259fa8 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.767309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b91d8-6db7-4110-8336-e4fd97259fa8 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.767558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b91d8-6db7-4110-8336-e4fd97259fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.791829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-cb8b91d8-6db7-4110-8336-e4fd97259fa8 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:37.793058 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-cb8b91d8-6db7-4110-8336-e4fd97259fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:37.806313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159561f7-a79d-407d-9bc1-8c91c5e211f7 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.863843 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1335/2665] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:37.874611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b91d8-6db7-4110-8336-e4fd97259fa8 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.875525 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567a97-52b6-44e1-8148-d67cee1415c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.876077 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-cb8b91d8-6db7-4110-8336-e4fd97259fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:37.876233 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567a97-52b6-44e1-8148-d67cee1415c3 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.876422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567a97-52b6-44e1-8148-d67cee1415c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.876722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567a97-52b6-44e1-8148-d67cee1415c3 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.877372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567a97-52b6-44e1-8148-d67cee1415c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.881308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567a97-52b6-44e1-8148-d67cee1415c3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:37.940471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b91d8-6db7-4110-8336-e4fd97259fa8 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.944319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acf479-4ec7-4eee-a5a1-5f180e185d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.945047 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acf479-4ec7-4eee-a5a1-5f180e185d34 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.950736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acf479-4ec7-4eee-a5a1-5f180e185d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.950736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acf479-4ec7-4eee-a5a1-5f180e185d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.956063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acf479-4ec7-4eee-a5a1-5f180e185d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.957700 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acf479-4ec7-4eee-a5a1-5f180e185d34 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:37.965221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:37.973884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1331/2666] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:37 2022] POST /identity/v3/users => generated 303 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:37.973884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567a97-52b6-44e1-8148-d67cee1415c3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.973884 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-20567a97-52b6-44e1-8148-d67cee1415c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:37.975759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1336/2667] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:37.976763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acf479-4ec7-4eee-a5a1-5f180e185d34 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:37.987486 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acf479-4ec7-4eee-a5a1-5f180e185d34 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.993432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567a97-52b6-44e1-8148-d67cee1415c3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:37.997699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582c3f0-f1fe-404a-a8f0-85ed13f15fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:37.997699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582c3f0-f1fe-404a-a8f0-85ed13f15fcc admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:37.997699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582c3f0-f1fe-404a-a8f0-85ed13f15fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:37.997699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582c3f0-f1fe-404a-a8f0-85ed13f15fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:37.998150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582c3f0-f1fe-404a-a8f0-85ed13f15fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:37.998150 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582c3f0-f1fe-404a-a8f0-85ed13f15fcc admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:38.000928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:38.001676 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.002019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.002363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] PATH_INFO: `/v3/projects/ca21d71bd6f6464c9f1e004c1710ea65` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.003595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca21d71bd6f6464c9f1e004c1710ea65)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:38.005612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:38.009995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1337/2668] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:38.014672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582c3f0-f1fe-404a-a8f0-85ed13f15fcc admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:38.025099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582c3f0-f1fe-404a-a8f0-85ed13f15fcc admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:38.029882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2fbda-2f91-4aa2-96aa-6db3147a6ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:38.030491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2fbda-2f91-4aa2-96aa-6db3147a6ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.030769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2fbda-2f91-4aa2-96aa-6db3147a6ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.031039 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2fbda-2f91-4aa2-96aa-6db3147a6ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.031679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2fbda-2f91-4aa2-96aa-6db3147a6ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:38.033447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2fbda-2f91-4aa2-96aa-6db3147a6ff7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:38.043663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1338/2669] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:38.047950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2fbda-2f91-4aa2-96aa-6db3147a6ff7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:38.058372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2fbda-2f91-4aa2-96aa-6db3147a6ff7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:38.063997 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de89de-dae5-4326-a155-cf9e55889b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:38.064618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de89de-dae5-4326-a155-cf9e55889b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.064947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de89de-dae5-4326-a155-cf9e55889b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.065770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de89de-dae5-4326-a155-cf9e55889b4a admin admin] PATH_INFO: `/v3/projects/0ad61ed652a349478f6992b5281ad475/users/24c8b11860cb4f0a9233e4efea8f999d/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.081237 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de89de-dae5-4326-a155-cf9e55889b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad61ed652a349478f6992b5281ad475, user_id=24c8b11860cb4f0a9233e4efea8f999d, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:38.083916 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de89de-dae5-4326-a155-cf9e55889b4a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:38.186722 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1339/2670] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:38 2022] PUT /identity/v3/projects/0ad61ed652a349478f6992b5281ad475/users/24c8b11860cb4f0a9233e4efea8f999d/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:38.196205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca21d71bd6f6464c9f1e004c1710ea65', 'request_id': 'req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:38.197431 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baa7d7-ddd4-4ed7-bd2b-fe7865d6fb9c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.197782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baa7d7-ddd4-4ed7-bd2b-fe7865d6fb9c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.198068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baa7d7-ddd4-4ed7-bd2b-fe7865d6fb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.208725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:38.226495 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-e5baa7d7-ddd4-4ed7-bd2b-fe7865d6fb9c None None] MFA Rules not processed for user `24c8b11860cb4f0a9233e4efea8f999d`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:38.227715 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-e5baa7d7-ddd4-4ed7-bd2b-fe7865d6fb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:38.282452 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca21d71bd6f6464c9f1e004c1710ea65', 'request_id': 'req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:38.290463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca21d71bd6f6464c9f1e004c1710ea65', 'request_id': 'req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:38.299668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1340/2671] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:38 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:38.304018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baa7d7-ddd4-4ed7-bd2b-fe7865d6fb9c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:38.310551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] The token cache is being invalidate because project ca21d71bd6f6464c9f1e004c1710ea65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:38.310551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:38.310551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9b71dae9-2e27-4b32-88cd-e24b723a8ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:38.310551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1332/2672] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:37 2022] DELETE /identity/v3/projects/ca21d71bd6f6464c9f1e004c1710ea65 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:38.318306 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768502c-5e25-4435-99b6-429e11225bbb None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.318595 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768502c-5e25-4435-99b6-429e11225bbb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.318874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768502c-5e25-4435-99b6-429e11225bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.345843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b768502c-5e25-4435-99b6-429e11225bbb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:38.347555 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b768502c-5e25-4435-99b6-429e11225bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:38.398570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baa7d7-ddd4-4ed7-bd2b-fe7865d6fb9c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:38.403725 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41557ea-c1c1-4b58-a151-ea079279b9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:38.414019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41557ea-c1c1-4b58-a151-ea079279b9ab admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.414019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41557ea-c1c1-4b58-a151-ea079279b9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.414019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41557ea-c1c1-4b58-a151-ea079279b9ab admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.414019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41557ea-c1c1-4b58-a151-ea079279b9ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:38.414019 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41557ea-c1c1-4b58-a151-ea079279b9ab admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:38.430737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1333/2673] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:38.432575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6288-8025-40c5-adc8-6e39df5be47d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.432871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6288-8025-40c5-adc8-6e39df5be47d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.433138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f6288-8025-40c5-adc8-6e39df5be47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.458121 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-b25f6288-8025-40c5-adc8-6e39df5be47d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:38.459989 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-b25f6288-8025-40c5-adc8-6e39df5be47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:38.472218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1334/2674] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:38.476056 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f6288-8025-40c5-adc8-6e39df5be47d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:38.486745 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f6288-8025-40c5-adc8-6e39df5be47d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:38.492737 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b9df8-30bf-402c-8baa-bb3a051a6aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:38.493415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b9df8-30bf-402c-8baa-bb3a051a6aac admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.493685 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b9df8-30bf-402c-8baa-bb3a051a6aac admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.493950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b9df8-30bf-402c-8baa-bb3a051a6aac admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.494661 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b9df8-30bf-402c-8baa-bb3a051a6aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:38.494953 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b9df8-30bf-402c-8baa-bb3a051a6aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:38.496568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b9df8-30bf-402c-8baa-bb3a051a6aac admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:38.511263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1335/2675] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:04:38.516438 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b9df8-30bf-402c-8baa-bb3a051a6aac admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:38.527022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b9df8-30bf-402c-8baa-bb3a051a6aac admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:38.532289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deeddb-452c-47df-910e-a6fe11e59fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:38.532919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deeddb-452c-47df-910e-a6fe11e59fce admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.533192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deeddb-452c-47df-910e-a6fe11e59fce admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.533458 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deeddb-452c-47df-910e-a6fe11e59fce admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.534086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deeddb-452c-47df-910e-a6fe11e59fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:38.536042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deeddb-452c-47df-910e-a6fe11e59fce admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:38.673216 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1341/2676] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:38 2022] POST /identity/v3/projects => generated 403 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:38.677195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41557ea-c1c1-4b58-a151-ea079279b9ab admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:38.678936 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d41557ea-c1c1-4b58-a151-ea079279b9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:38.716176 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1336/2677] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:38 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:38.722361 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deeddb-452c-47df-910e-a6fe11e59fce admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:38.807405 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deeddb-452c-47df-910e-a6fe11e59fce admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:38.816637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0293a-7833-489a-b506-0d6e6c4fd9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:38.817417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0293a-7833-489a-b506-0d6e6c4fd9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.817825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0293a-7833-489a-b506-0d6e6c4fd9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.818390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0293a-7833-489a-b506-0d6e6c4fd9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.819209 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0293a-7833-489a-b506-0d6e6c4fd9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:38.821574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0293a-7833-489a-b506-0d6e6c4fd9b4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:38.873769 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41557ea-c1c1-4b58-a151-ea079279b9ab admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:38.879587 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d340cf-d1ac-49f8-8d3e-61189fba6bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:38.880286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d340cf-d1ac-49f8-8d3e-61189fba6bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.880610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d340cf-d1ac-49f8-8d3e-61189fba6bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.881797 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d340cf-d1ac-49f8-8d3e-61189fba6bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.882793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d340cf-d1ac-49f8-8d3e-61189fba6bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:38.885819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d340cf-d1ac-49f8-8d3e-61189fba6bb8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:38.949085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1337/2678] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:38 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:38.950627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0293a-7833-489a-b506-0d6e6c4fd9b4 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:38.961766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0293a-7833-489a-b506-0d6e6c4fd9b4 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:38.966868 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8258f25-0b2b-4c43-ac78-1d3e3f7919c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:38.967620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8258f25-0b2b-4c43-ac78-1d3e3f7919c4 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:38.967938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8258f25-0b2b-4c43-ac78-1d3e3f7919c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:38.968255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8258f25-0b2b-4c43-ac78-1d3e3f7919c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:38.968956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8258f25-0b2b-4c43-ac78-1d3e3f7919c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:38.970698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8258f25-0b2b-4c43-ac78-1d3e3f7919c4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:38.982712 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1338/2679] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:38.988604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8258f25-0b2b-4c43-ac78-1d3e3f7919c4 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:38.997785 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1342/2680] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:38 2022] POST /identity/v3/users => generated 308 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:38.999720 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8258f25-0b2b-4c43-ac78-1d3e3f7919c4 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.001539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d340cf-d1ac-49f8-8d3e-61189fba6bb8 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.005608 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2dc8e-31af-43bc-b54e-da854534f996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.006236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2dc8e-31af-43bc-b54e-da854534f996 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.006566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2dc8e-31af-43bc-b54e-da854534f996 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.006840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2dc8e-31af-43bc-b54e-da854534f996 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.007504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2dc8e-31af-43bc-b54e-da854534f996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.009159 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2dc8e-31af-43bc-b54e-da854534f996 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.020985 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d340cf-d1ac-49f8-8d3e-61189fba6bb8 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.021231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1339/2681] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:39.025615 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2dc8e-31af-43bc-b54e-da854534f996 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.035061 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e997a-8a0e-47ea-b46a-018625811c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.035693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e997a-8a0e-47ea-b46a-018625811c1c admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.035970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e997a-8a0e-47ea-b46a-018625811c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.036242 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e997a-8a0e-47ea-b46a-018625811c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.036924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e997a-8a0e-47ea-b46a-018625811c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.038746 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e997a-8a0e-47ea-b46a-018625811c1c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.043105 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2dc8e-31af-43bc-b54e-da854534f996 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.046148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bac65-b786-4dea-b88b-bab473f5d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.046969 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bac65-b786-4dea-b88b-bab473f5d99c admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.047119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bac65-b786-4dea-b88b-bab473f5d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.047389 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bac65-b786-4dea-b88b-bab473f5d99c admin admin] PATH_INFO: `/v3/projects/df5033968a7740e4b946bedcb1148823/users/a958315e19fb4fc1b4a7ed39594abc40/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.052935 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1343/2682] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:39.057387 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e997a-8a0e-47ea-b46a-018625811c1c admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.068996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e997a-8a0e-47ea-b46a-018625811c1c admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.071391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bac65-b786-4dea-b88b-bab473f5d99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5033968a7740e4b946bedcb1148823, user_id=a958315e19fb4fc1b4a7ed39594abc40, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.073871 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0203e8c-8ef7-4e5b-876c-febb8a21cacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.074582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203e8c-8ef7-4e5b-876c-febb8a21cacc admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.074865 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203e8c-8ef7-4e5b-876c-febb8a21cacc admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.075228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bac65-b786-4dea-b88b-bab473f5d99c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.075363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203e8c-8ef7-4e5b-876c-febb8a21cacc admin admin] PATH_INFO: `/v3/projects/301388221f614a518fa78ca80cef6b91/users/12ec40715a904b08b1bf501c7c0fed8c/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.091797 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0203e8c-8ef7-4e5b-876c-febb8a21cacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=301388221f614a518fa78ca80cef6b91, user_id=12ec40715a904b08b1bf501c7c0fed8c, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.094534 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0203e8c-8ef7-4e5b-876c-febb8a21cacc admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.186582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1340/2683] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:39 2022] PUT /identity/v3/projects/df5033968a7740e4b946bedcb1148823/users/a958315e19fb4fc1b4a7ed39594abc40/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:39.226633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1344/2684] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:39 2022] PUT /identity/v3/projects/301388221f614a518fa78ca80cef6b91/users/12ec40715a904b08b1bf501c7c0fed8c/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:39.235399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bac65-b786-4dea-b88b-bab473f5d99c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.256699 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4d9e9-79c0-4ba0-be81-3fca4a4fb625 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.257120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4d9e9-79c0-4ba0-be81-3fca4a4fb625 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.257245 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4d9e9-79c0-4ba0-be81-3fca4a4fb625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.286876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-b8b4d9e9-79c0-4ba0-be81-3fca4a4fb625 None None] MFA Rules not processed for user `a958315e19fb4fc1b4a7ed39594abc40`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:39.288610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b8b4d9e9-79c0-4ba0-be81-3fca4a4fb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:39.305965 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bac65-b786-4dea-b88b-bab473f5d99c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.334712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:39.372857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1345/2685] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:39.373213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b20031-0086-4d55-888a-9b829ac9b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.373404 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b20031-0086-4d55-888a-9b829ac9b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.373607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b20031-0086-4d55-888a-9b829ac9b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.373936 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b20031-0086-4d55-888a-9b829ac9b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.374536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b20031-0086-4d55-888a-9b829ac9b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.376313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b20031-0086-4d55-888a-9b829ac9b9eb admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.377538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4d9e9-79c0-4ba0-be81-3fca4a4fb625 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.389015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1341/2686] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:39.393585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4d9e9-79c0-4ba0-be81-3fca4a4fb625 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.394347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735674-757e-4d00-b78f-051d0e2ce576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.395064 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b20031-0086-4d55-888a-9b829ac9b9eb admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.395201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735674-757e-4d00-b78f-051d0e2ce576 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.395349 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735674-757e-4d00-b78f-051d0e2ce576 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.395635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc735674-757e-4d00-b78f-051d0e2ce576 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.400988 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc735674-757e-4d00-b78f-051d0e2ce576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.405543 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc735674-757e-4d00-b78f-051d0e2ce576 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.410910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b20031-0086-4d55-888a-9b829ac9b9eb admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.420122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c3f75-0d98-4983-8f28-b93b46db7192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.420843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c3f75-0d98-4983-8f28-b93b46db7192 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.421152 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c3f75-0d98-4983-8f28-b93b46db7192 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.421426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c3f75-0d98-4983-8f28-b93b46db7192 admin admin] PATH_INFO: `/v3/projects/301388221f614a518fa78ca80cef6b91/users/12ec40715a904b08b1bf501c7c0fed8c/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.423417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c3f75-0d98-4983-8f28-b93b46db7192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301388221f614a518fa78ca80cef6b91, user_id=12ec40715a904b08b1bf501c7c0fed8c, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.426124 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c3f75-0d98-4983-8f28-b93b46db7192 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.437875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1342/2687] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:39 2022] PUT /identity/v3/projects/301388221f614a518fa78ca80cef6b91/users/12ec40715a904b08b1bf501c7c0fed8c/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:39.458539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487c366-7897-4ec4-87d3-3bf5f1311ef2 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.458821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487c366-7897-4ec4-87d3-3bf5f1311ef2 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.459094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487c366-7897-4ec4-87d3-3bf5f1311ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.488398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:39.489667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-a487c366-7897-4ec4-87d3-3bf5f1311ef2 None None] MFA Rules not processed for user `12ec40715a904b08b1bf501c7c0fed8c`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:39.490971 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a487c366-7897-4ec4-87d3-3bf5f1311ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:39.494785 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1346/2688] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:39 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:39.499440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735674-757e-4d00-b78f-051d0e2ce576 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.572787 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc735674-757e-4d00-b78f-051d0e2ce576 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.573527 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1343/2689] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:39 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:39.581747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f77ab9-c43e-4afb-b771-9e19361b38a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.582378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f77ab9-c43e-4afb-b771-9e19361b38a6 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.582653 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f77ab9-c43e-4afb-b771-9e19361b38a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.582923 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f77ab9-c43e-4afb-b771-9e19361b38a6 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.583676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f77ab9-c43e-4afb-b771-9e19361b38a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.585643 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f77ab9-c43e-4afb-b771-9e19361b38a6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.588408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487c366-7897-4ec4-87d3-3bf5f1311ef2 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.590202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a487c366-7897-4ec4-87d3-3bf5f1311ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:39.662242 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487c366-7897-4ec4-87d3-3bf5f1311ef2 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.666866 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1347/2690] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:39 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:39.667982 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab946ce-7702-4b7d-a2d8-2a0d15825c84 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.668185 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab946ce-7702-4b7d-a2d8-2a0d15825c84 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.668442 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab946ce-7702-4b7d-a2d8-2a0d15825c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.705606 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-fab946ce-7702-4b7d-a2d8-2a0d15825c84 None None] MFA Rules not processed for user `d954426082884655a74bfda0b985045d`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:39.708160 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fab946ce-7702-4b7d-a2d8-2a0d15825c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:39.727550 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d021d-c2b0-4fe2-82b9-b11200271291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.728188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d021d-c2b0-4fe2-82b9-b11200271291 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.728464 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d021d-c2b0-4fe2-82b9-b11200271291 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.728846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d021d-c2b0-4fe2-82b9-b11200271291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.796876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1348/2691] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:39.798708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab946ce-7702-4b7d-a2d8-2a0d15825c84 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.811580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d021d-c2b0-4fe2-82b9-b11200271291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.811951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab946ce-7702-4b7d-a2d8-2a0d15825c84 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.813861 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d021d-c2b0-4fe2-82b9-b11200271291 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.817957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b491e-ee16-4a7a-87d2-926e33e2b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.818562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b491e-ee16-4a7a-87d2-926e33e2b878 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.818967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b491e-ee16-4a7a-87d2-926e33e2b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.819510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b491e-ee16-4a7a-87d2-926e33e2b878 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.820328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b491e-ee16-4a7a-87d2-926e33e2b878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.822348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b491e-ee16-4a7a-87d2-926e33e2b878 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.829432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1344/2692] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:39 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:39.843871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d021d-c2b0-4fe2-82b9-b11200271291 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.843871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-026d021d-c2b0-4fe2-82b9-b11200271291 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:39.844483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1349/2693] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:39.845857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b491e-ee16-4a7a-87d2-926e33e2b878 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:39.858847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d021d-c2b0-4fe2-82b9-b11200271291 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.866026 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b491e-ee16-4a7a-87d2-926e33e2b878 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:39.866469 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021972-ba1e-4c33-a7c7-2e8820c848aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.867470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021972-ba1e-4c33-a7c7-2e8820c848aa admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.867803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021972-ba1e-4c33-a7c7-2e8820c848aa admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.868151 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021972-ba1e-4c33-a7c7-2e8820c848aa admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.870192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9021972-ba1e-4c33-a7c7-2e8820c848aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.878240 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9021972-ba1e-4c33-a7c7-2e8820c848aa admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.879123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e00b6-13c2-44c4-ad27-4acd3e9228a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:39.879123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e00b6-13c2-44c4-ad27-4acd3e9228a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:39.879123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e00b6-13c2-44c4-ad27-4acd3e9228a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:39.879388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e00b6-13c2-44c4-ad27-4acd3e9228a6 admin admin] PATH_INFO: `/v3/projects/f42bd8cf39a34187b49e2c2aed4bfb6f/users/8795889f38f34c30b60ce11f8ac25a91/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:39.909011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e00b6-13c2-44c4-ad27-4acd3e9228a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42bd8cf39a34187b49e2c2aed4bfb6f, user_id=8795889f38f34c30b60ce11f8ac25a91, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:39.912063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e00b6-13c2-44c4-ad27-4acd3e9228a6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:39.931302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:39.979835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1345/2694] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:39 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:39.984987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021972-ba1e-4c33-a7c7-2e8820c848aa admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:40.003233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1350/2695] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:39 2022] PUT /identity/v3/projects/f42bd8cf39a34187b49e2c2aed4bfb6f/users/8795889f38f34c30b60ce11f8ac25a91/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:40.004430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e00b6-13c2-44c4-ad27-4acd3e9228a6 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:40.021620 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:40.066454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021972-ba1e-4c33-a7c7-2e8820c848aa admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:40.078059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e00b6-13c2-44c4-ad27-4acd3e9228a6 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:40.082902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:40.083553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.083831 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.084101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] PATH_INFO: `/v3/users/24c8b11860cb4f0a9233e4efea8f999d` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.085282 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c8b11860cb4f0a9233e4efea8f999d)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:40.087460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:40.100385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:40.128610 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:40.136007 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55db018-ddf7-4477-89e9-416bbe98ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:40.136687 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55db018-ddf7-4477-89e9-416bbe98ab1e admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.136962 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55db018-ddf7-4477-89e9-416bbe98ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.137228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55db018-ddf7-4477-89e9-416bbe98ab1e admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.137957 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55db018-ddf7-4477-89e9-416bbe98ab1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:40.139902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55db018-ddf7-4477-89e9-416bbe98ab1e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:40.295340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1346/2696] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:39 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:40.296830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55db018-ddf7-4477-89e9-416bbe98ab1e admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:40.309586 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55db018-ddf7-4477-89e9-416bbe98ab1e admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:40.314877 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cb460-4b67-47d4-81a4-d4b98d551f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:40.315506 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cb460-4b67-47d4-81a4-d4b98d551f7f admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.315790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cb460-4b67-47d4-81a4-d4b98d551f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.316239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cb460-4b67-47d4-81a4-d4b98d551f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.317010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cb460-4b67-47d4-81a4-d4b98d551f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:40.318601 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cb460-4b67-47d4-81a4-d4b98d551f7f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:40.323612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c8b11860cb4f0a9233e4efea8f999d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:40.331980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c8b11860cb4f0a9233e4efea8f999d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:40.339267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1347/2697] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:40.340390 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cb460-4b67-47d4-81a4-d4b98d551f7f admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:40.351553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cb460-4b67-47d4-81a4-d4b98d551f7f admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:40.357979 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962534f-23cc-4470-afbe-4220e19a641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:40.358638 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962534f-23cc-4470-afbe-4220e19a641d admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.359067 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962534f-23cc-4470-afbe-4220e19a641d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.359356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962534f-23cc-4470-afbe-4220e19a641d admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.360076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962534f-23cc-4470-afbe-4220e19a641d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:40.361742 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962534f-23cc-4470-afbe-4220e19a641d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:40.374097 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1348/2698] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:40.374978 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962534f-23cc-4470-afbe-4220e19a641d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:40.385044 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:40.385634 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962534f-23cc-4470-afbe-4220e19a641d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:40.391824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfa34-c119-4443-87c3-94b51298eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:40.394883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfa34-c119-4443-87c3-94b51298eb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.394883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfa34-c119-4443-87c3-94b51298eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.394883 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfa34-c119-4443-87c3-94b51298eb18 admin admin] PATH_INFO: `/v3/projects/f42bd8cf39a34187b49e2c2aed4bfb6f/users/8795889f38f34c30b60ce11f8ac25a91/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.395309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bfa34-c119-4443-87c3-94b51298eb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42bd8cf39a34187b49e2c2aed4bfb6f, user_id=8795889f38f34c30b60ce11f8ac25a91, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:40.397817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bfa34-c119-4443-87c3-94b51298eb18 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:40.409828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1349/2699] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:40 2022] PUT /identity/v3/projects/f42bd8cf39a34187b49e2c2aed4bfb6f/users/8795889f38f34c30b60ce11f8ac25a91/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:40.410811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfa34-c119-4443-87c3-94b51298eb18 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:40.418689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c8b11860cb4f0a9233e4efea8f999d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:40.419596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c8b11860cb4f0a9233e4efea8f999d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:40.423033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c103c243-067a-4c85-9f27-067759050fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c8b11860cb4f0a9233e4efea8f999d'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:40.440911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1351/2700] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:40 2022] DELETE /identity/v3/users/24c8b11860cb4f0a9233e4efea8f999d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:40.445170 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a895-c7c2-4e2b-9aea-11bfdfd5c9fd None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.445582 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a895-c7c2-4e2b-9aea-11bfdfd5c9fd None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.445726 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a895-c7c2-4e2b-9aea-11bfdfd5c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.478508 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0386a895-c7c2-4e2b-9aea-11bfdfd5c9fd None None] MFA Rules not processed for user `8795889f38f34c30b60ce11f8ac25a91`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:40.479745 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0386a895-c7c2-4e2b-9aea-11bfdfd5c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:40.487505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfa34-c119-4443-87c3-94b51298eb18 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:40.552489 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2176c4-3a06-4d8b-bb78-236ab00656c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:40.553535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2176c4-3a06-4d8b-bb78-236ab00656c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.554106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2176c4-3a06-4d8b-bb78-236ab00656c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.554443 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2176c4-3a06-4d8b-bb78-236ab00656c8 admin admin] PATH_INFO: `/v3/projects/a1c5aad0571f4122a00370eeeccd8a75/users/73ea27a8e1d64bdbbca079916a4c3934/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.560958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1352/2701] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:40.562025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4a0bd-1b19-4e3f-a096-04b663229b76 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.562300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4a0bd-1b19-4e3f-a096-04b663229b76 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.562711 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4a0bd-1b19-4e3f-a096-04b663229b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.582556 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2176c4-3a06-4d8b-bb78-236ab00656c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c5aad0571f4122a00370eeeccd8a75, user_id=73ea27a8e1d64bdbbca079916a4c3934, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:40.586960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2176c4-3a06-4d8b-bb78-236ab00656c8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:40.594319 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:40.594899 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-aeb4a0bd-1b19-4e3f-a096-04b663229b76 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:40.598015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-aeb4a0bd-1b19-4e3f-a096-04b663229b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:40.612805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1353/2702] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:40.612805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4a0bd-1b19-4e3f-a096-04b663229b76 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:40.612805 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-aeb4a0bd-1b19-4e3f-a096-04b663229b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:40.631659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:40.685572 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4a0bd-1b19-4e3f-a096-04b663229b76 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:40.689796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddfabc-947e-458f-b2c7-667507e7ef40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:40.690599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddfabc-947e-458f-b2c7-667507e7ef40 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.690914 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddfabc-947e-458f-b2c7-667507e7ef40 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.691153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddfabc-947e-458f-b2c7-667507e7ef40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.702517 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddfabc-947e-458f-b2c7-667507e7ef40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:40.704017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddfabc-947e-458f-b2c7-667507e7ef40 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:40.715194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1354/2703] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:40.716612 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddfabc-947e-458f-b2c7-667507e7ef40 service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:40.718132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c5ddfabc-947e-458f-b2c7-667507e7ef40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:40.723011 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1350/2704] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:40 2022] PUT /identity/v3/projects/a1c5aad0571f4122a00370eeeccd8a75/users/73ea27a8e1d64bdbbca079916a4c3934/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:40.726858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2176c4-3a06-4d8b-bb78-236ab00656c8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:40.732123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-db2176c4-3a06-4d8b-bb78-236ab00656c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:40.809869 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddfabc-947e-458f-b2c7-667507e7ef40 service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:40.836966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2176c4-3a06-4d8b-bb78-236ab00656c8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:40.846015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56590bda-a13c-4491-b30c-9cf6a5412e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:40.847106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590bda-a13c-4491-b30c-9cf6a5412e0d admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.847612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590bda-a13c-4491-b30c-9cf6a5412e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.848111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56590bda-a13c-4491-b30c-9cf6a5412e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.849419 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56590bda-a13c-4491-b30c-9cf6a5412e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:40.852473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56590bda-a13c-4491-b30c-9cf6a5412e0d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:40.878837 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1351/2705] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:40.879435 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f2fbe-bd30-4976-85f4-c865850c8fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:40.880163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f2fbe-bd30-4976-85f4-c865850c8fce service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.880483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f2fbe-bd30-4976-85f4-c865850c8fce service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.880896 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f2fbe-bd30-4976-85f4-c865850c8fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.883395 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56590bda-a13c-4491-b30c-9cf6a5412e0d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:40.898081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56590bda-a13c-4491-b30c-9cf6a5412e0d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:40.898193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f2fbe-bd30-4976-85f4-c865850c8fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:40.902928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f2fbe-bd30-4976-85f4-c865850c8fce service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:40.911397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7de66-9dc8-40b0-a0c3-1ca13e2a1a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:40.912093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7de66-9dc8-40b0-a0c3-1ca13e2a1a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.912377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7de66-9dc8-40b0-a0c3-1ca13e2a1a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.912703 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7de66-9dc8-40b0-a0c3-1ca13e2a1a2b admin admin] PATH_INFO: `/v3/projects/a1c5aad0571f4122a00370eeeccd8a75/users/73ea27a8e1d64bdbbca079916a4c3934/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.915026 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7de66-9dc8-40b0-a0c3-1ca13e2a1a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c5aad0571f4122a00370eeeccd8a75, user_id=73ea27a8e1d64bdbbca079916a4c3934, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:40.920099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7de66-9dc8-40b0-a0c3-1ca13e2a1a2b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:40.942125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:40.948795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1355/2707] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:40.949541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1352/2707] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:40 2022] PUT /identity/v3/projects/a1c5aad0571f4122a00370eeeccd8a75/users/73ea27a8e1d64bdbbca079916a4c3934/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:41.316658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:41.337739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:41.633265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f2fbe-bd30-4976-85f4-c865850c8fce service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:41.636018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-7f0f2fbe-bd30-4976-85f4-c865850c8fce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:41.657004 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f2fbe-bd30-4976-85f4-c865850c8fce service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:41.765300 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:41.766192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:41.768505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:41.768925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] PATH_INFO: `/v3/users/a958315e19fb4fc1b4a7ed39594abc40` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:41.770645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a958315e19fb4fc1b4a7ed39594abc40)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:41.773575 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:41.892447 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7de66-9dc8-40b0-a0c3-1ca13e2a1a2b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:41.895841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-01d7de66-9dc8-40b0-a0c3-1ca13e2a1a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:41.912211 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7de66-9dc8-40b0-a0c3-1ca13e2a1a2b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:41.925191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:41.925191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:41.925191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:41.925191 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] PATH_INFO: `/v3/projects/0ad61ed652a349478f6992b5281ad475` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:41.925786 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad61ed652a349478f6992b5281ad475)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:41.930305 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:42.039804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a958315e19fb4fc1b4a7ed39594abc40'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.053816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a958315e19fb4fc1b4a7ed39594abc40'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.114728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad61ed652a349478f6992b5281ad475', 'request_id': 'req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.204219 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a958315e19fb4fc1b4a7ed39594abc40'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.206182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a958315e19fb4fc1b4a7ed39594abc40'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.207079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-07e0c4e0-14dc-45d7-9cf4-5e196aee1d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a958315e19fb4fc1b4a7ed39594abc40'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.260978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1356/2708] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:41 2022] DELETE /identity/v3/users/a958315e19fb4fc1b4a7ed39594abc40 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:42.266323 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde301f-643d-4e17-a32c-ffd7da55ccb4 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:42.267116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde301f-643d-4e17-a32c-ffd7da55ccb4 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:42.267462 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde301f-643d-4e17-a32c-ffd7da55ccb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:42.292069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3cde301f-643d-4e17-a32c-ffd7da55ccb4 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:42.299596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3cde301f-643d-4e17-a32c-ffd7da55ccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:42.333973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad61ed652a349478f6992b5281ad475', 'request_id': 'req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.344086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad61ed652a349478f6992b5281ad475', 'request_id': 'req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.361086 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:42.365829 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] The token cache is being invalidate because project 0ad61ed652a349478f6992b5281ad475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:42.366119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.367193 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.368724 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1353/2709] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:41 2022] DELETE /identity/v3/projects/0ad61ed652a349478f6992b5281ad475 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:42.374454 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:42.379879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:42.383058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:42.384305 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1357/2710] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:42.395816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde301f-643d-4e17-a32c-ffd7da55ccb4 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:42.397181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3cde301f-643d-4e17-a32c-ffd7da55ccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:42.481053 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde301f-643d-4e17-a32c-ffd7da55ccb4 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:42.484844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a388b-ac19-4aa0-b7db-12ca5f4bd17d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:42.489576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6593905-5008-4ca8-928f-dc82d4eaeddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:42.489576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593905-5008-4ca8-928f-dc82d4eaeddc service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:42.489576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593905-5008-4ca8-928f-dc82d4eaeddc service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:42.489576 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593905-5008-4ca8-928f-dc82d4eaeddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:42.490580 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:42.491421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:42.491774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:42.492140 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] PATH_INFO: `/v3/users/12ec40715a904b08b1bf501c7c0fed8c` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:42.498313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ec40715a904b08b1bf501c7c0fed8c)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:42.500655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:42.505534 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6593905-5008-4ca8-928f-dc82d4eaeddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:42.509068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6593905-5008-4ca8-928f-dc82d4eaeddc service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:42.523611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1358/2711] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:42.757391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ec40715a904b08b1bf501c7c0fed8c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.809854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ec40715a904b08b1bf501c7c0fed8c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.885542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356edf0-1352-4506-b53a-d8154dc187c0 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:42.886259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356edf0-1352-4506-b53a-d8154dc187c0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:42.886774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356edf0-1352-4506-b53a-d8154dc187c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:42.899996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ec40715a904b08b1bf501c7c0fed8c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.901947 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ec40715a904b08b1bf501c7c0fed8c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.931718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0356edf0-1352-4506-b53a-d8154dc187c0 None None] MFA Rules not processed for user `73ea27a8e1d64bdbbca079916a4c3934`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:42.934301 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0356edf0-1352-4506-b53a-d8154dc187c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:42.945015 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ec40715a904b08b1bf501c7c0fed8c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:42.962996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1354/2712] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:42 2022] DELETE /identity/v3/users/12ec40715a904b08b1bf501c7c0fed8c => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:43.025916 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:43.027445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:43.073090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1359/2713] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:43.142556 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b2568-ecfa-4fc0-832c-2f12ed99d30a None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:43.142924 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b2568-ecfa-4fc0-832c-2f12ed99d30a None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:43.143494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b2568-ecfa-4fc0-832c-2f12ed99d30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:43.164491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72532c-3a3c-4e20-a3fe-f939caf1f32c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:43.166351 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-c80b2568-ecfa-4fc0-832c-2f12ed99d30a None None] MFA Rules not processed for user `d954426082884655a74bfda0b985045d`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:43.167851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c80b2568-ecfa-4fc0-832c-2f12ed99d30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:43.172796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:43.173738 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:43.174100 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:43.175220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] PATH_INFO: `/v3/projects/df5033968a7740e4b946bedcb1148823` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:43.177500 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5033968a7740e4b946bedcb1148823)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:43.180214 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:43.239445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1360/2714] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:43.253879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b2568-ecfa-4fc0-832c-2f12ed99d30a None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:43.256434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c80b2568-ecfa-4fc0-832c-2f12ed99d30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:43.360212 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5033968a7740e4b946bedcb1148823', 'request_id': 'req-9a4b4f96-211c-4931-bff2-e9a46288bd21'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:43.379085 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b2568-ecfa-4fc0-832c-2f12ed99d30a None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:43.471240 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f8952-0890-4e0a-bce8-a1756ef92942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c12495a6cf64c80b45785f185f28383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:43.472036 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8952-0890-4e0a-bce8-a1756ef92942 service nova] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:43.472546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8952-0890-4e0a-bce8-a1756ef92942 service nova] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:43.472752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f8952-0890-4e0a-bce8-a1756ef92942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:43.474779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c29f8952-0890-4e0a-bce8-a1756ef92942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:43.484190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5033968a7740e4b946bedcb1148823', 'request_id': 'req-9a4b4f96-211c-4931-bff2-e9a46288bd21'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:43.493668 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5033968a7740e4b946bedcb1148823', 'request_id': 'req-9a4b4f96-211c-4931-bff2-e9a46288bd21'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:43.507009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] The token cache is being invalidate because project df5033968a7740e4b946bedcb1148823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:43.507425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:43.508070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:43.510166 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1355/2715] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:43 2022] DELETE /identity/v3/projects/df5033968a7740e4b946bedcb1148823 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:43.514815 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:43.517213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:43.553490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f8952-0890-4e0a-bce8-a1756ef92942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:43.555213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f8952-0890-4e0a-bce8-a1756ef92942 service nova] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:43.565919 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1361/2716] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:43.584803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f8952-0890-4e0a-bce8-a1756ef92942 service nova] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:43.587447 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c29f8952-0890-4e0a-bce8-a1756ef92942 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:43.604056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:43.674200 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b4f96-211c-4931-bff2-e9a46288bd21 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:43.682510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f8952-0890-4e0a-bce8-a1756ef92942 service nova] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:43.683009 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:43.684077 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:43.684987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:43.685656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] PATH_INFO: `/v3/users/8795889f38f34c30b60ce11f8ac25a91` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:43.688928 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:43.689820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:43.690098 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:43.690265 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:43.690425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] PATH_INFO: `/v3/projects/301388221f614a518fa78ca80cef6b91` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:43.691538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301388221f614a518fa78ca80cef6b91)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:43.692072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8795889f38f34c30b60ce11f8ac25a91)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:43.694257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:43.696910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:43.826728 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301388221f614a518fa78ca80cef6b91', 'request_id': 'req-bf26b700-8492-4205-b4b1-80ea84543342'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:43.835822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301388221f614a518fa78ca80cef6b91', 'request_id': 'req-bf26b700-8492-4205-b4b1-80ea84543342'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:43.845809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301388221f614a518fa78ca80cef6b91', 'request_id': 'req-bf26b700-8492-4205-b4b1-80ea84543342'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:43.975073 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] The token cache is being invalidate because project 301388221f614a518fa78ca80cef6b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:43.975768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:43.978154 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:43.978934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:43.981473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1362/2717] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:43 2022] DELETE /identity/v3/projects/301388221f614a518fa78ca80cef6b91 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:43.982586 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:43.984719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:43.990260 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8795889f38f34c30b60ce11f8ac25a91'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:44.007090 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8795889f38f34c30b60ce11f8ac25a91'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:44.063379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26b700-8492-4205-b4b1-80ea84543342 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:44.068355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d3b4-50d3-40fe-a531-a527657a3fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:44.068355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d3b4-50d3-40fe-a531-a527657a3fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:44.068355 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d3b4-50d3-40fe-a531-a527657a3fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:44.069079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d3b4-50d3-40fe-a531-a527657a3fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:44.073115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5598d3b4-50d3-40fe-a531-a527657a3fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:44.095316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598d3b4-50d3-40fe-a531-a527657a3fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:44.096168 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8795889f38f34c30b60ce11f8ac25a91'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:44.102373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8795889f38f34c30b60ce11f8ac25a91'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:44.102822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598d3b4-50d3-40fe-a531-a527657a3fd4 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:44.127192 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1363/2718] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:44.131751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-b5048f1c-52a1-4cf0-9eb8-a6b2a07dd685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8795889f38f34c30b60ce11f8ac25a91'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:44.144424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1356/2719] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:43 2022] DELETE /identity/v3/users/8795889f38f34c30b60ce11f8ac25a91 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:44.153108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503fba7-40c2-46cf-88fa-2b0b2a453d87 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:44.153774 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503fba7-40c2-46cf-88fa-2b0b2a453d87 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:44.154208 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503fba7-40c2-46cf-88fa-2b0b2a453d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:44.237102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-8503fba7-40c2-46cf-88fa-2b0b2a453d87 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:44.241319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8503fba7-40c2-46cf-88fa-2b0b2a453d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:44.393127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1364/2720] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:44.409422 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d3929-1f53-4ca6-be58-69f88a1eecf7 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:44.409802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d3929-1f53-4ca6-be58-69f88a1eecf7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:44.410185 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d3929-1f53-4ca6-be58-69f88a1eecf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:44.495795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-723d3929-1f53-4ca6-be58-69f88a1eecf7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:44.500372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-723d3929-1f53-4ca6-be58-69f88a1eecf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:44.520846 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1357/2721] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:44.525210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503fba7-40c2-46cf-88fa-2b0b2a453d87 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:44.562438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503fba7-40c2-46cf-88fa-2b0b2a453d87 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:44.609243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde7a65-3a36-4c30-bbfa-bef71ca7a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:44.609996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde7a65-3a36-4c30-bbfa-bef71ca7a304 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:44.610429 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde7a65-3a36-4c30-bbfa-bef71ca7a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:44.610844 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde7a65-3a36-4c30-bbfa-bef71ca7a304 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:44.611857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde7a65-3a36-4c30-bbfa-bef71ca7a304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:44.634416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde7a65-3a36-4c30-bbfa-bef71ca7a304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:44.636101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde7a65-3a36-4c30-bbfa-bef71ca7a304 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:44.672100 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1365/2722] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:44.677036 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d3929-1f53-4ca6-be58-69f88a1eecf7 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:44.695147 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d3929-1f53-4ca6-be58-69f88a1eecf7 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:44.711285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e9fe-76c6-4da2-8246-529c363ab7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:44.713551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e9fe-76c6-4da2-8246-529c363ab7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:44.714021 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e9fe-76c6-4da2-8246-529c363ab7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:44.714980 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6e9fe-76c6-4da2-8246-529c363ab7a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:44.717474 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6e9fe-76c6-4da2-8246-529c363ab7a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:44.721413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6e9fe-76c6-4da2-8246-529c363ab7a6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:44.857295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1358/2723] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:44 2022] POST /identity/v3/projects => generated 405 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:44.861791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde7a65-3a36-4c30-bbfa-bef71ca7a304 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:44.874453 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde7a65-3a36-4c30-bbfa-bef71ca7a304 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:44.892059 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:44.937852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e9fe-76c6-4da2-8246-529c363ab7a6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:44.941465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-01c6e9fe-76c6-4da2-8246-529c363ab7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:44.947896 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:45.029737 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57700da8-1dc8-4ad9-8246-c00edb1abaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.030505 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700da8-1dc8-4ad9-8246-c00edb1abaa2 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.030851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700da8-1dc8-4ad9-8246-c00edb1abaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.031360 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700da8-1dc8-4ad9-8246-c00edb1abaa2 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.032127 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57700da8-1dc8-4ad9-8246-c00edb1abaa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.034929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57700da8-1dc8-4ad9-8246-c00edb1abaa2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.052561 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6e9fe-76c6-4da2-8246-529c363ab7a6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.061044 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.061717 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.062052 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.062333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] PATH_INFO: `/v3/projects/f42bd8cf39a34187b49e2c2aed4bfb6f` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.063747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42bd8cf39a34187b49e2c2aed4bfb6f)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.067148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.184093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1366/2724] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:44 2022] POST /identity/v3/users => generated 303 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:45.188853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57700da8-1dc8-4ad9-8246-c00edb1abaa2 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.205483 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57700da8-1dc8-4ad9-8246-c00edb1abaa2 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.235201 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0222c3-7d28-4c75-9d4c-6cf96eadc20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.235846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0222c3-7d28-4c75-9d4c-6cf96eadc20b admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.236123 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0222c3-7d28-4c75-9d4c-6cf96eadc20b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.236397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0222c3-7d28-4c75-9d4c-6cf96eadc20b admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.240095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42bd8cf39a34187b49e2c2aed4bfb6f', 'request_id': 'req-ba1d87c6-1d29-49be-9355-e18d4316af4c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:45.240887 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0222c3-7d28-4c75-9d4c-6cf96eadc20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.243801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0222c3-7d28-4c75-9d4c-6cf96eadc20b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.269411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1367/2725] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:45.275479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0222c3-7d28-4c75-9d4c-6cf96eadc20b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.294867 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0222c3-7d28-4c75-9d4c-6cf96eadc20b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.358456 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42bd8cf39a34187b49e2c2aed4bfb6f', 'request_id': 'req-ba1d87c6-1d29-49be-9355-e18d4316af4c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:45.374342 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42bd8cf39a34187b49e2c2aed4bfb6f', 'request_id': 'req-ba1d87c6-1d29-49be-9355-e18d4316af4c'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:45.397808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] The token cache is being invalidate because project f42bd8cf39a34187b49e2c2aed4bfb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:45.398466 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:45.400902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ba1d87c6-1d29-49be-9355-e18d4316af4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:45.409987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1359/2726] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:44 2022] DELETE /identity/v3/projects/f42bd8cf39a34187b49e2c2aed4bfb6f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:45.410144 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16f391-7e2f-484e-904b-1762de26a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.410144 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f391-7e2f-484e-904b-1762de26a5af admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.410144 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f391-7e2f-484e-904b-1762de26a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.410144 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16f391-7e2f-484e-904b-1762de26a5af admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.410910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16f391-7e2f-484e-904b-1762de26a5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.410910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16f391-7e2f-484e-904b-1762de26a5af admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.411102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010dea8-acf9-48bb-808a-b1a5c0e550d1 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.411102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010dea8-acf9-48bb-808a-b1a5c0e550d1 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.411102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010dea8-acf9-48bb-808a-b1a5c0e550d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.429860 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1368/2727] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:45.435604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16f391-7e2f-484e-904b-1762de26a5af admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.437047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-1010dea8-acf9-48bb-808a-b1a5c0e550d1 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:45.438115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-8b16f391-7e2f-484e-904b-1762de26a5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:45.438867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-1010dea8-acf9-48bb-808a-b1a5c0e550d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:45.449842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1360/2728] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:45.453473 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16f391-7e2f-484e-904b-1762de26a5af admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.458333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b7202-619c-4dd7-b0f8-0441c064b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.459126 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b7202-619c-4dd7-b0f8-0441c064b0db admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.459409 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b7202-619c-4dd7-b0f8-0441c064b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.459684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b7202-619c-4dd7-b0f8-0441c064b0db admin admin] PATH_INFO: `/v3/projects/766a178a38f74a20ac16fb9da521eac2/users/f38a31b4be3b4fe7b41c3a426b092a2c/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.461747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8217-0c89-47cb-8f1c-2b46968af8bb None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.462041 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8217-0c89-47cb-8f1c-2b46968af8bb None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.462327 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed8217-0c89-47cb-8f1c-2b46968af8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.487393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b7202-619c-4dd7-b0f8-0441c064b0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=766a178a38f74a20ac16fb9da521eac2, user_id=f38a31b4be3b4fe7b41c3a426b092a2c, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.490388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b7202-619c-4dd7-b0f8-0441c064b0db admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.494314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-07ed8217-0c89-47cb-8f1c-2b46968af8bb None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:45.495761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-07ed8217-0c89-47cb-8f1c-2b46968af8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:45.504541 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1361/2729] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:45.508775 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed8217-0c89-47cb-8f1c-2b46968af8bb None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.518723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed8217-0c89-47cb-8f1c-2b46968af8bb None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.523747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36e9e-155d-4590-a563-5bfc4b9212f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.524394 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36e9e-155d-4590-a563-5bfc4b9212f2 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.524705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36e9e-155d-4590-a563-5bfc4b9212f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.525068 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36e9e-155d-4590-a563-5bfc4b9212f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.525901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b36e9e-155d-4590-a563-5bfc4b9212f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:45.526131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b36e9e-155d-4590-a563-5bfc4b9212f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.528418 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b36e9e-155d-4590-a563-5bfc4b9212f2 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.544588 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1362/2730] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:04:45.548637 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36e9e-155d-4590-a563-5bfc4b9212f2 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.559034 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36e9e-155d-4590-a563-5bfc4b9212f2 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.564239 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072412db-a8ba-46bc-a423-ea35536d9ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.564890 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072412db-a8ba-46bc-a423-ea35536d9ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.565173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072412db-a8ba-46bc-a423-ea35536d9ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.565444 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072412db-a8ba-46bc-a423-ea35536d9ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.566244 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072412db-a8ba-46bc-a423-ea35536d9ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.568347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072412db-a8ba-46bc-a423-ea35536d9ec8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.641768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1369/2731] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:45 2022] PUT /identity/v3/projects/766a178a38f74a20ac16fb9da521eac2/users/f38a31b4be3b4fe7b41c3a426b092a2c/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:45.646906 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e88c6-31e5-4d88-8f57-159dec5cc7fd None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.647196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e88c6-31e5-4d88-8f57-159dec5cc7fd None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.647506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e88c6-31e5-4d88-8f57-159dec5cc7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.669828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1363/2732] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:45 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:45.675701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072412db-a8ba-46bc-a423-ea35536d9ec8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.675861 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-6c5e88c6-31e5-4d88-8f57-159dec5cc7fd None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:45.676966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6c5e88c6-31e5-4d88-8f57-159dec5cc7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:45.743852 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072412db-a8ba-46bc-a423-ea35536d9ec8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.748811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbced287-fa2f-4e9e-ab1c-20704e5b4455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.749429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbced287-fa2f-4e9e-ab1c-20704e5b4455 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.752778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbced287-fa2f-4e9e-ab1c-20704e5b4455 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.752778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbced287-fa2f-4e9e-ab1c-20704e5b4455 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.753033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1370/2733] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:45.753122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbced287-fa2f-4e9e-ab1c-20704e5b4455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.753122 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbced287-fa2f-4e9e-ab1c-20704e5b4455 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.759859 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e88c6-31e5-4d88-8f57-159dec5cc7fd None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.761559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6c5e88c6-31e5-4d88-8f57-159dec5cc7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:45.767619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:45.769718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:45.838442 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e88c6-31e5-4d88-8f57-159dec5cc7fd None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.843399 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587438b-1cad-40a1-8a8c-bd69dc6ba3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.844161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587438b-1cad-40a1-8a8c-bd69dc6ba3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.844536 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587438b-1cad-40a1-8a8c-bd69dc6ba3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.844878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587438b-1cad-40a1-8a8c-bd69dc6ba3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.854761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1364/2734] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:45 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:45.858131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587438b-1cad-40a1-8a8c-bd69dc6ba3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.858131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587438b-1cad-40a1-8a8c-bd69dc6ba3d9 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.859604 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbced287-fa2f-4e9e-ab1c-20704e5b4455 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.870887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbced287-fa2f-4e9e-ab1c-20704e5b4455 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.883217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707bd86-ff23-471f-bd8d-351ecd972547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.883676 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1371/2735] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:45.883796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707bd86-ff23-471f-bd8d-351ecd972547 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.883796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707bd86-ff23-471f-bd8d-351ecd972547 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.883796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707bd86-ff23-471f-bd8d-351ecd972547 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.883796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707bd86-ff23-471f-bd8d-351ecd972547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.883796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707bd86-ff23-471f-bd8d-351ecd972547 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.894722 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1365/2736] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:45.897587 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587438b-1cad-40a1-8a8c-bd69dc6ba3d9 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.918407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587438b-1cad-40a1-8a8c-bd69dc6ba3d9 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.918407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a4bac-c40a-4500-a995-716f82582967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.918407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a4bac-c40a-4500-a995-716f82582967 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.918407 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a4bac-c40a-4500-a995-716f82582967 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.919035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a4bac-c40a-4500-a995-716f82582967 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.919035 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a4bac-c40a-4500-a995-716f82582967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.920589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a4bac-c40a-4500-a995-716f82582967 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:45.936195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1372/2737] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:45.937624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707bd86-ff23-471f-bd8d-351ecd972547 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.948409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707bd86-ff23-471f-bd8d-351ecd972547 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.954082 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e440c52-dedd-4df7-b363-e2b5d4d2b803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.954812 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e440c52-dedd-4df7-b363-e2b5d4d2b803 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.955098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e440c52-dedd-4df7-b363-e2b5d4d2b803 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.962616 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e440c52-dedd-4df7-b363-e2b5d4d2b803 admin admin] PATH_INFO: `/v3/projects/4c4aca17c83e4d44add847f4a3222171/users/1c818108dd024e7cb3e752c015cd5c5b/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.973226 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e440c52-dedd-4df7-b363-e2b5d4d2b803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4aca17c83e4d44add847f4a3222171, user_id=1c818108dd024e7cb3e752c015cd5c5b, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:45.975870 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e440c52-dedd-4df7-b363-e2b5d4d2b803 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:46.068406 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1366/2738] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:45 2022] PUT /identity/v3/projects/4c4aca17c83e4d44add847f4a3222171/users/1c818108dd024e7cb3e752c015cd5c5b/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:46.079852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae0267-f51d-47ab-8088-0e77c91dfead None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:46.080040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae0267-f51d-47ab-8088-0e77c91dfead None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:46.080313 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae0267-f51d-47ab-8088-0e77c91dfead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:46.113499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-9dae0267-f51d-47ab-8088-0e77c91dfead None None] MFA Rules not processed for user `1c818108dd024e7cb3e752c015cd5c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:46.114860 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9dae0267-f51d-47ab-8088-0e77c91dfead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:46.217347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1373/2739] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:46.228645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e440c52-dedd-4df7-b363-e2b5d4d2b803 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:46.230409 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8e440c52-dedd-4df7-b363-e2b5d4d2b803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:46.317565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e440c52-dedd-4df7-b363-e2b5d4d2b803 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:46.322461 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a291-ecc7-4f4c-ae17-ac1e18e3ee49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2de83ba29194578a9a229d5bab6612e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:46.323114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a291-ecc7-4f4c-ae17-ac1e18e3ee49 service glance] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:46.323414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a291-ecc7-4f4c-ae17-ac1e18e3ee49 service glance] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:46.323686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a291-ecc7-4f4c-ae17-ac1e18e3ee49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:46.335765 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72a291-ecc7-4f4c-ae17-ac1e18e3ee49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:46.338224 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72a291-ecc7-4f4c-ae17-ac1e18e3ee49 service glance] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:46.352357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1367/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:47.305207 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c96c-38fe-430b-85e5-0888b52e5ea7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:47.306168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c96c-38fe-430b-85e5-0888b52e5ea7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:47.306638 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7c96c-38fe-430b-85e5-0888b52e5ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:47.371244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-08d7c96c-38fe-430b-85e5-0888b52e5ea7 None None] MFA Rules not processed for user `f38a31b4be3b4fe7b41c3a426b092a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:47.372972 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-08d7c96c-38fe-430b-85e5-0888b52e5ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:47.450970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1374/2741] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:47 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:47.455355 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a291-ecc7-4f4c-ae17-ac1e18e3ee49 service glance] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:47.538375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a291-ecc7-4f4c-ae17-ac1e18e3ee49 service glance] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:47.543228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f5e29-8754-4847-b95d-115a7246da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:47.543976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f5e29-8754-4847-b95d-115a7246da46 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:47.544299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f5e29-8754-4847-b95d-115a7246da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:47.544697 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f5e29-8754-4847-b95d-115a7246da46 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:47.545410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f5e29-8754-4847-b95d-115a7246da46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:47.548157 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f5e29-8754-4847-b95d-115a7246da46 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:47.732014 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1368/2742] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:47 2022] POST /identity/v3/projects => generated 405 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:47.732136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7c96c-38fe-430b-85e5-0888b52e5ea7 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:47.741627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7c96c-38fe-430b-85e5-0888b52e5ea7 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:47.758541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:47.815088 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00d3f-de19-42fe-9dc9-7ee63544c3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:47.815732 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00d3f-de19-42fe-9dc9-7ee63544c3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:47.815998 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00d3f-de19-42fe-9dc9-7ee63544c3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:47.816278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba00d3f-de19-42fe-9dc9-7ee63544c3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:47.816963 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba00d3f-de19-42fe-9dc9-7ee63544c3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:47.819188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba00d3f-de19-42fe-9dc9-7ee63544c3b6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:47.945615 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1375/2743] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:47 2022] POST /identity/v3/users => generated 309 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:47.952192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f5e29-8754-4847-b95d-115a7246da46 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:47.972689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f5e29-8754-4847-b95d-115a7246da46 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:47.977851 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f77173-0530-468b-aef0-93a556d1026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:47.978512 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77173-0530-468b-aef0-93a556d1026f admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:47.978795 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77173-0530-468b-aef0-93a556d1026f admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:47.979710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77173-0530-468b-aef0-93a556d1026f admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:47.979853 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f77173-0530-468b-aef0-93a556d1026f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:47.982118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f77173-0530-468b-aef0-93a556d1026f admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:47.997294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1369/2744] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:48.001648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00d3f-de19-42fe-9dc9-7ee63544c3b6 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:48.012333 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba00d3f-de19-42fe-9dc9-7ee63544c3b6 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:48.017303 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cdb3f-bc16-4cfc-8b91-1943ad548154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:48.017973 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cdb3f-bc16-4cfc-8b91-1943ad548154 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.021759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cdb3f-bc16-4cfc-8b91-1943ad548154 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.021759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cdb3f-bc16-4cfc-8b91-1943ad548154 admin admin] PATH_INFO: `/v3/projects/4cce6bf3b11a4f2d8d5ffa7ed271cfde/users/9101d5f951e94aaf9da622774d5b7423/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.037002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cdb3f-bc16-4cfc-8b91-1943ad548154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cce6bf3b11a4f2d8d5ffa7ed271cfde, user_id=9101d5f951e94aaf9da622774d5b7423, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:48.039880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cdb3f-bc16-4cfc-8b91-1943ad548154 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:48.134424 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1376/2745] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:48 2022] PUT /identity/v3/projects/4cce6bf3b11a4f2d8d5ffa7ed271cfde/users/9101d5f951e94aaf9da622774d5b7423/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:48.138968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f77173-0530-468b-aef0-93a556d1026f admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:48.153274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f77173-0530-468b-aef0-93a556d1026f admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:48.166922 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:48.219104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f033d1b-312f-4077-bfb4-8339d0085cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:48.219644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f033d1b-312f-4077-bfb4-8339d0085cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.219995 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f033d1b-312f-4077-bfb4-8339d0085cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.220468 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f033d1b-312f-4077-bfb4-8339d0085cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.221155 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f033d1b-312f-4077-bfb4-8339d0085cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:48.222824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f033d1b-312f-4077-bfb4-8339d0085cf4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:48.240141 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1370/2746] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:48.242451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cdb3f-bc16-4cfc-8b91-1943ad548154 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:48.254925 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cdb3f-bc16-4cfc-8b91-1943ad548154 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:48.259992 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3639e8-ff86-400d-af7a-6c6613aa5aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:48.263995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3639e8-ff86-400d-af7a-6c6613aa5aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.263995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3639e8-ff86-400d-af7a-6c6613aa5aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.263995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3639e8-ff86-400d-af7a-6c6613aa5aa8 admin admin] PATH_INFO: `/v3/projects/4cce6bf3b11a4f2d8d5ffa7ed271cfde/users/9101d5f951e94aaf9da622774d5b7423/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.263995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3639e8-ff86-400d-af7a-6c6613aa5aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cce6bf3b11a4f2d8d5ffa7ed271cfde, user_id=9101d5f951e94aaf9da622774d5b7423, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:48.266176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3639e8-ff86-400d-af7a-6c6613aa5aa8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:48.282463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1377/2747] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:48 2022] PUT /identity/v3/projects/4cce6bf3b11a4f2d8d5ffa7ed271cfde/users/9101d5f951e94aaf9da622774d5b7423/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:49.530864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9bb13-1424-452b-918d-ec1a8a573227 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:49.531453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9bb13-1424-452b-918d-ec1a8a573227 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:49.531453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9bb13-1424-452b-918d-ec1a8a573227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:49.572414 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-25a9bb13-1424-452b-918d-ec1a8a573227 None None] MFA Rules not processed for user `9101d5f951e94aaf9da622774d5b7423`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:49.587880 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-25a9bb13-1424-452b-918d-ec1a8a573227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:49.730705 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1371/2748] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:49 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:52.016882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3639e8-ff86-400d-af7a-6c6613aa5aa8 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:52.084363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3639e8-ff86-400d-af7a-6c6613aa5aa8 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:52.089244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:52.089880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:52.094895 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:52.094895 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] PATH_INFO: `/v3/users/f38a31b4be3b4fe7b41c3a426b092a2c` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:52.094895 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38a31b4be3b4fe7b41c3a426b092a2c)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:52.094895 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:52.302320 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38a31b4be3b4fe7b41c3a426b092a2c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:52.311494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38a31b4be3b4fe7b41c3a426b092a2c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:52.367497 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38a31b4be3b4fe7b41c3a426b092a2c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:52.368109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38a31b4be3b4fe7b41c3a426b092a2c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:52.368842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38a31b4be3b4fe7b41c3a426b092a2c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:52.376397 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:52.390613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1378/2749] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:52 2022] DELETE /identity/v3/users/f38a31b4be3b4fe7b41c3a426b092a2c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:52.649381 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9bb13-1424-452b-918d-ec1a8a573227 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:52.661377 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9bb13-1424-452b-918d-ec1a8a573227 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:52.734016 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:52.734927 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:52.735132 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:52.735410 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] PATH_INFO: `/v3/projects/766a178a38f74a20ac16fb9da521eac2` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:52.736598 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=766a178a38f74a20ac16fb9da521eac2)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:52.738523 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:52.857347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:52.864784 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766a178a38f74a20ac16fb9da521eac2', 'request_id': 'req-8ba6a314-f03b-466a-b11f-2c04d95741cc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:52.944641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766a178a38f74a20ac16fb9da521eac2', 'request_id': 'req-8ba6a314-f03b-466a-b11f-2c04d95741cc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:52.952928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766a178a38f74a20ac16fb9da521eac2', 'request_id': 'req-8ba6a314-f03b-466a-b11f-2c04d95741cc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:52.972000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] The token cache is being invalidate because project 766a178a38f74a20ac16fb9da521eac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:52.972261 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:52.973037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8ba6a314-f03b-466a-b11f-2c04d95741cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:52.974577 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1372/2750] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:52 2022] DELETE /identity/v3/projects/766a178a38f74a20ac16fb9da521eac2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:52.979540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:52.982897 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:52.983372 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ce3f5-86f4-4b99-af88-400af4b7f78b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:52.983701 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ce3f5-86f4-4b99-af88-400af4b7f78b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:52.983973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ce3f5-86f4-4b99-af88-400af4b7f78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:53.005909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-9b9ce3f5-86f4-4b99-af88-400af4b7f78b None None] MFA Rules not processed for user `3f087c40f6514c3a84a4131bc5585fea`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:53.007366 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9b9ce3f5-86f4-4b99-af88-400af4b7f78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:53.011870 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd7f3e-8224-469d-9a86-0fc38468a5fb admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:53.069186 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1373/2751] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 16:04:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:53.095063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:53.095724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:53.096009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:53.096278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] PATH_INFO: `/v3/users/9101d5f951e94aaf9da622774d5b7423` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:53.097514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9101d5f951e94aaf9da622774d5b7423)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:53.099452 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:53.257777 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ce3f5-86f4-4b99-af88-400af4b7f78b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:53.259274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9b9ce3f5-86f4-4b99-af88-400af4b7f78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:53.318778 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9101d5f951e94aaf9da622774d5b7423'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:53.328507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9101d5f951e94aaf9da622774d5b7423'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:53.348043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ce3f5-86f4-4b99-af88-400af4b7f78b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:53.353174 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc656b1d-6455-48cb-abb1-da9847d29b35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92bc91b8b5224bd18f79bd8ea4663d3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:53.353780 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc656b1d-6455-48cb-abb1-da9847d29b35 service swift] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:53.354066 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc656b1d-6455-48cb-abb1-da9847d29b35 service swift] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:53.354343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc656b1d-6455-48cb-abb1-da9847d29b35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:53.363568 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc656b1d-6455-48cb-abb1-da9847d29b35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:53.365362 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc656b1d-6455-48cb-abb1-da9847d29b35 service swift] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:53.374582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1374/2752] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 16:04:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:04:53.385033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9101d5f951e94aaf9da622774d5b7423'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:53.385822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9101d5f951e94aaf9da622774d5b7423'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:53.386512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-bc0757bb-c2ac-4284-a0d9-96fe8c1e3d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9101d5f951e94aaf9da622774d5b7423'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:53.413275 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1379/2753] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:52 2022] DELETE /identity/v3/users/9101d5f951e94aaf9da622774d5b7423 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:53.771070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc656b1d-6455-48cb-abb1-da9847d29b35 service swift] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:53.773123 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-bc656b1d-6455-48cb-abb1-da9847d29b35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:53.790279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc656b1d-6455-48cb-abb1-da9847d29b35 service swift] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:53.869548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:53.870215 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:53.870497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:53.870769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] PATH_INFO: `/v3/projects/4cce6bf3b11a4f2d8d5ffa7ed271cfde` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:53.872037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cce6bf3b11a4f2d8d5ffa7ed271cfde)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:53.874005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:53.877421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:53.988875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cce6bf3b11a4f2d8d5ffa7ed271cfde', 'request_id': 'req-8671b939-3004-4fb3-a7ee-d8203eaa85b4'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:54.070188 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cce6bf3b11a4f2d8d5ffa7ed271cfde', 'request_id': 'req-8671b939-3004-4fb3-a7ee-d8203eaa85b4'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:54.082612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cce6bf3b11a4f2d8d5ffa7ed271cfde', 'request_id': 'req-8671b939-3004-4fb3-a7ee-d8203eaa85b4'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:54.092844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] The token cache is being invalidate because project 4cce6bf3b11a4f2d8d5ffa7ed271cfde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:54.093270 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:54.094074 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-8671b939-3004-4fb3-a7ee-d8203eaa85b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:54.095759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1375/2754] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:53 2022] DELETE /identity/v3/projects/4cce6bf3b11a4f2d8d5ffa7ed271cfde => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:54.100832 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71e36a-f99b-4d11-b707-18ca8823006e None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:54.101326 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71e36a-f99b-4d11-b707-18ca8823006e None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:54.101428 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71e36a-f99b-4d11-b707-18ca8823006e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:54.124149 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-9c71e36a-f99b-4d11-b707-18ca8823006e None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:54.125438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-9c71e36a-f99b-4d11-b707-18ca8823006e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:54.201675 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1380/2755] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:54.210150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba7b07-0f63-4eaa-bb9c-9b86bf8a9141 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:54.210434 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba7b07-0f63-4eaa-bb9c-9b86bf8a9141 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:54.210708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba7b07-0f63-4eaa-bb9c-9b86bf8a9141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:54.231652 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-8fba7b07-0f63-4eaa-bb9c-9b86bf8a9141 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:54.232921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-8fba7b07-0f63-4eaa-bb9c-9b86bf8a9141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:54.241083 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1376/2756] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:54.245664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71e36a-f99b-4d11-b707-18ca8823006e None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:54.252820 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:54.256487 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71e36a-f99b-4d11-b707-18ca8823006e None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:54.262324 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab8e8-3be6-4379-a245-82c169857134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:54.265806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab8e8-3be6-4379-a245-82c169857134 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:54.265806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab8e8-3be6-4379-a245-82c169857134 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:54.265806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfab8e8-3be6-4379-a245-82c169857134 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:54.265806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfab8e8-3be6-4379-a245-82c169857134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:54.265806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfab8e8-3be6-4379-a245-82c169857134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:54.266902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfab8e8-3be6-4379-a245-82c169857134 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:54.280605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1381/2757] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:04:54.285195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba7b07-0f63-4eaa-bb9c-9b86bf8a9141 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:54.295682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba7b07-0f63-4eaa-bb9c-9b86bf8a9141 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:54.300481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc53df-f1eb-4f08-a5a3-4347a0a42ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:54.301119 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc53df-f1eb-4f08-a5a3-4347a0a42ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:54.301441 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc53df-f1eb-4f08-a5a3-4347a0a42ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:54.301706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc53df-f1eb-4f08-a5a3-4347a0a42ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:54.302341 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc53df-f1eb-4f08-a5a3-4347a0a42ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:54.304271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc53df-f1eb-4f08-a5a3-4347a0a42ad9 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:54.444262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1377/2758] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:54 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:54.448250 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab8e8-3be6-4379-a245-82c169857134 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:54.458232 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfab8e8-3be6-4379-a245-82c169857134 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:54.523451 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf42e6-e6b1-4245-a334-5abd1d9cf4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:54.524085 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf42e6-e6b1-4245-a334-5abd1d9cf4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:54.524365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf42e6-e6b1-4245-a334-5abd1d9cf4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:54.524691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf42e6-e6b1-4245-a334-5abd1d9cf4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:54.525384 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf42e6-e6b1-4245-a334-5abd1d9cf4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:54.528079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf42e6-e6b1-4245-a334-5abd1d9cf4d6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:54.616089 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1382/2759] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:54 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:54.620131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc53df-f1eb-4f08-a5a3-4347a0a42ad9 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:54.635488 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc53df-f1eb-4f08-a5a3-4347a0a42ad9 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:54.642575 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255d776-8ff1-4c7e-b664-81d6ed93a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:54.645189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255d776-8ff1-4c7e-b664-81d6ed93a407 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:54.645189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255d776-8ff1-4c7e-b664-81d6ed93a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:54.645189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255d776-8ff1-4c7e-b664-81d6ed93a407 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:54.657333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255d776-8ff1-4c7e-b664-81d6ed93a407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:54.657333 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255d776-8ff1-4c7e-b664-81d6ed93a407 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:54.659625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1378/2760] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:54.663607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf42e6-e6b1-4245-a334-5abd1d9cf4d6 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:54.674959 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf42e6-e6b1-4245-a334-5abd1d9cf4d6 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:54.681392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd737df-cd73-40c0-a3c6-3edb8f8806c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:54.682021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd737df-cd73-40c0-a3c6-3edb8f8806c2 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:54.682301 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd737df-cd73-40c0-a3c6-3edb8f8806c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:54.682609 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd737df-cd73-40c0-a3c6-3edb8f8806c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:54.683523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd737df-cd73-40c0-a3c6-3edb8f8806c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:54.685607 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd737df-cd73-40c0-a3c6-3edb8f8806c2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:54.707224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1383/2761] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:54.712233 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255d776-8ff1-4c7e-b664-81d6ed93a407 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:54.724126 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255d776-8ff1-4c7e-b664-81d6ed93a407 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:54.729376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df6098-43c9-463f-be22-4dfa7fb82d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:54.730560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6098-43c9-463f-be22-4dfa7fb82d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:54.730975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6098-43c9-463f-be22-4dfa7fb82d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:54.731356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6098-43c9-463f-be22-4dfa7fb82d54 admin admin] PATH_INFO: `/v3/projects/3950f42c245b4b48aff6083d7a730f81/users/45d31195c8464a698391a5c959187abd/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:54.758018 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df6098-43c9-463f-be22-4dfa7fb82d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3950f42c245b4b48aff6083d7a730f81, user_id=45d31195c8464a698391a5c959187abd, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:54.761140 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df6098-43c9-463f-be22-4dfa7fb82d54 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:54.849504 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1379/2762] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:54 2022] PUT /identity/v3/projects/3950f42c245b4b48aff6083d7a730f81/users/45d31195c8464a698391a5c959187abd/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:54.859806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec32d5f-5f8b-4b43-9794-f5cc56e87eb1 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:54.860083 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec32d5f-5f8b-4b43-9794-f5cc56e87eb1 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:54.860357 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec32d5f-5f8b-4b43-9794-f5cc56e87eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:54.890782 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0ec32d5f-5f8b-4b43-9794-f5cc56e87eb1 None None] MFA Rules not processed for user `45d31195c8464a698391a5c959187abd`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:54.894736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0ec32d5f-5f8b-4b43-9794-f5cc56e87eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:54.977213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1384/2763] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:54.981755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df6098-43c9-463f-be22-4dfa7fb82d54 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:55.068858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df6098-43c9-463f-be22-4dfa7fb82d54 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:55.074087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ecefe-5aad-4503-ad91-398dfcf8a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:55.075268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ecefe-5aad-4503-ad91-398dfcf8a526 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:55.075551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ecefe-5aad-4503-ad91-398dfcf8a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:55.075827 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ecefe-5aad-4503-ad91-398dfcf8a526 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:55.076478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ecefe-5aad-4503-ad91-398dfcf8a526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:55.078488 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ecefe-5aad-4503-ad91-398dfcf8a526 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:55.166560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1380/2764] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:54 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:55.167814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec32d5f-5f8b-4b43-9794-f5cc56e87eb1 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:55.186812 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec32d5f-5f8b-4b43-9794-f5cc56e87eb1 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:55.263388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfede5-339a-498a-bac4-d96084511b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:55.264178 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfede5-339a-498a-bac4-d96084511b1f admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:55.264577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfede5-339a-498a-bac4-d96084511b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:55.264946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfede5-339a-498a-bac4-d96084511b1f admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:55.265747 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfede5-339a-498a-bac4-d96084511b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:55.267848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfede5-339a-498a-bac4-d96084511b1f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:55.277730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:55.411595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1385/2765] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:55 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:55.415952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ecefe-5aad-4503-ad91-398dfcf8a526 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:55.428225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ecefe-5aad-4503-ad91-398dfcf8a526 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:55.434863 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe26e9-d17c-40b2-a230-36caf74ff419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:55.435941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe26e9-d17c-40b2-a230-36caf74ff419 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:55.436802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe26e9-d17c-40b2-a230-36caf74ff419 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:55.436802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe26e9-d17c-40b2-a230-36caf74ff419 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:55.441114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe26e9-d17c-40b2-a230-36caf74ff419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:55.441114 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe26e9-d17c-40b2-a230-36caf74ff419 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:55.450758 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1381/2766] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:55.454940 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfede5-339a-498a-bac4-d96084511b1f admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:55.465350 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfede5-339a-498a-bac4-d96084511b1f admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:55.470741 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91031cf-4a2b-4708-9444-bc7e332fd3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:55.471420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91031cf-4a2b-4708-9444-bc7e332fd3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:55.471694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91031cf-4a2b-4708-9444-bc7e332fd3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:55.471964 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91031cf-4a2b-4708-9444-bc7e332fd3f8 admin admin] PATH_INFO: `/v3/projects/d704fe07f58842ddbcfb0101855f1bb7/users/9862d05f34914c72adb0d7e1a399f46d/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:55.494270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91031cf-4a2b-4708-9444-bc7e332fd3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d704fe07f58842ddbcfb0101855f1bb7, user_id=9862d05f34914c72adb0d7e1a399f46d, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:55.497712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91031cf-4a2b-4708-9444-bc7e332fd3f8 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:55.563763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1386/2767] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:55 2022] PUT /identity/v3/projects/d704fe07f58842ddbcfb0101855f1bb7/users/9862d05f34914c72adb0d7e1a399f46d/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:55.569010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe26e9-d17c-40b2-a230-36caf74ff419 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:55.576651 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:55.582983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe26e9-d17c-40b2-a230-36caf74ff419 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:55.675391 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fbbde-a2b0-4001-a20d-87b83fa6ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:55.675968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fbbde-a2b0-4001-a20d-87b83fa6ba13 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:55.676249 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fbbde-a2b0-4001-a20d-87b83fa6ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:55.677220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fbbde-a2b0-4001-a20d-87b83fa6ba13 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:55.677220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fbbde-a2b0-4001-a20d-87b83fa6ba13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:55.679322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fbbde-a2b0-4001-a20d-87b83fa6ba13 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:55.696289 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1382/2768] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:55.701263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91031cf-4a2b-4708-9444-bc7e332fd3f8 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:55.717978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91031cf-4a2b-4708-9444-bc7e332fd3f8 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:55.728819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dff97-1acc-453c-a212-da838f20db81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:55.728819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dff97-1acc-453c-a212-da838f20db81 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:55.731542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dff97-1acc-453c-a212-da838f20db81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:55.732131 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dff97-1acc-453c-a212-da838f20db81 admin admin] PATH_INFO: `/v3/projects/d704fe07f58842ddbcfb0101855f1bb7/users/9862d05f34914c72adb0d7e1a399f46d/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:55.736015 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586dff97-1acc-453c-a212-da838f20db81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d704fe07f58842ddbcfb0101855f1bb7, user_id=9862d05f34914c72adb0d7e1a399f46d, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:55.740678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586dff97-1acc-453c-a212-da838f20db81 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:55.755848 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1387/2769] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:55 2022] PUT /identity/v3/projects/d704fe07f58842ddbcfb0101855f1bb7/users/9862d05f34914c72adb0d7e1a399f46d/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:55.773104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38059c42-1091-4160-a1b0-702f93c83d16 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:55.773104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38059c42-1091-4160-a1b0-702f93c83d16 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:55.773104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38059c42-1091-4160-a1b0-702f93c83d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:55.823320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-38059c42-1091-4160-a1b0-702f93c83d16 None None] MFA Rules not processed for user `9862d05f34914c72adb0d7e1a399f46d`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:55.825035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-38059c42-1091-4160-a1b0-702f93c83d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:56.031000 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1383/2770] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:56.044703 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dff97-1acc-453c-a212-da838f20db81 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:56.046710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-586dff97-1acc-453c-a212-da838f20db81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:56.122845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dff97-1acc-453c-a212-da838f20db81 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:56.127347 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a86a00-8710-49ce-aff5-78bbc525a318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:56.127967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a86a00-8710-49ce-aff5-78bbc525a318 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:56.128248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a86a00-8710-49ce-aff5-78bbc525a318 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:56.128552 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a86a00-8710-49ce-aff5-78bbc525a318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:56.144252 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a86a00-8710-49ce-aff5-78bbc525a318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:56.145971 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a86a00-8710-49ce-aff5-78bbc525a318 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:56.166514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1388/2771] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:57.210968 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38059c42-1091-4160-a1b0-702f93c83d16 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:57.298206 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38059c42-1091-4160-a1b0-702f93c83d16 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:57.304739 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:57.305926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:57.306725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:57.306725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] PATH_INFO: `/v3/users/45d31195c8464a698391a5c959187abd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:57.307956 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d31195c8464a698391a5c959187abd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:57.310189 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:57.408893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:57.497287 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d31195c8464a698391a5c959187abd'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:57.509010 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d31195c8464a698391a5c959187abd'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:57.608202 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d31195c8464a698391a5c959187abd'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:57.609161 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d31195c8464a698391a5c959187abd'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:57.618340 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d31195c8464a698391a5c959187abd'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:57.624837 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1384/2772] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:57 2022] DELETE /identity/v3/users/45d31195c8464a698391a5c959187abd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:57.629610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27360777-3d68-4912-a2bc-f152c38b0e86 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:57.630151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27360777-3d68-4912-a2bc-f152c38b0e86 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:57.630151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27360777-3d68-4912-a2bc-f152c38b0e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:57.651007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-27360777-3d68-4912-a2bc-f152c38b0e86 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:57.653206 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-27360777-3d68-4912-a2bc-f152c38b0e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:57.721939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1389/2773] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:57.737818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:57.739835 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:57.829183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e957c-ff98-4703-a34b-b07690af7596 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:57.833062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677e381-3fca-46e4-bddf-b8332caf49f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:57.833682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677e381-3fca-46e4-bddf-b8332caf49f3 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:57.833950 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677e381-3fca-46e4-bddf-b8332caf49f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:57.834218 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677e381-3fca-46e4-bddf-b8332caf49f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:57.851431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677e381-3fca-46e4-bddf-b8332caf49f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:57.854553 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677e381-3fca-46e4-bddf-b8332caf49f3 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:57.871908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1385/2774] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:58.546659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27360777-3d68-4912-a2bc-f152c38b0e86 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:58.548175 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-27360777-3d68-4912-a2bc-f152c38b0e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:58.572809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27360777-3d68-4912-a2bc-f152c38b0e86 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:58.581584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:58.583247 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:58.583853 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:58.584292 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] PATH_INFO: `/v3/projects/3950f42c245b4b48aff6083d7a730f81` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:58.586090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3950f42c245b4b48aff6083d7a730f81)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:58.588639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:58.739558 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3950f42c245b4b48aff6083d7a730f81', 'request_id': 'req-cf826136-3b69-431a-83fb-6b4b1c777de9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:58.741552 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:58.747764 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3950f42c245b4b48aff6083d7a730f81', 'request_id': 'req-cf826136-3b69-431a-83fb-6b4b1c777de9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:58.755137 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3950f42c245b4b48aff6083d7a730f81', 'request_id': 'req-cf826136-3b69-431a-83fb-6b4b1c777de9'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:58.864484 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] The token cache is being invalidate because project 3950f42c245b4b48aff6083d7a730f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:58.864798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:58.865459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:58.875757 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1390/2775] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:58 2022] DELETE /identity/v3/projects/3950f42c245b4b48aff6083d7a730f81 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:58.876426 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677e381-3fca-46e4-bddf-b8332caf49f3 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:58.882367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677e381-3fca-46e4-bddf-b8332caf49f3 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:58.973094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:58.973823 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:58.974343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:58.974625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] PATH_INFO: `/v3/users/9862d05f34914c72adb0d7e1a399f46d` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:58.975948 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9862d05f34914c72adb0d7e1a399f46d)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:58.977966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:59.194347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9862d05f34914c72adb0d7e1a399f46d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:59.195648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:59.208113 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9862d05f34914c72adb0d7e1a399f46d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:59.379062 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9862d05f34914c72adb0d7e1a399f46d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:59.379717 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9862d05f34914c72adb0d7e1a399f46d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:59.389434 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3f86027e-239e-49ab-8624-d5bff7ae5ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9862d05f34914c72adb0d7e1a399f46d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:59.396352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1386/2776] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:58 2022] DELETE /identity/v3/users/9862d05f34914c72adb0d7e1a399f46d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:59.998678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:00.001346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:00.041356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf826136-3b69-431a-83fb-6b4b1c777de9 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:00.127408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:00.128072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:00.128348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:00.128852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] PATH_INFO: `/v3/projects/d704fe07f58842ddbcfb0101855f1bb7` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:00.130101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d704fe07f58842ddbcfb0101855f1bb7)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:00.132619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:00.283530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd704fe07f58842ddbcfb0101855f1bb7', 'request_id': 'req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:00.298227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd704fe07f58842ddbcfb0101855f1bb7', 'request_id': 'req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:00.307379 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd704fe07f58842ddbcfb0101855f1bb7', 'request_id': 'req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:00.486064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] The token cache is being invalidate because project d704fe07f58842ddbcfb0101855f1bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:00.486064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:00.486064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-79ccb030-3d2f-41d4-a009-2dd8eaac19a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:00.491826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1391/2777] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:59 2022] DELETE /identity/v3/projects/d704fe07f58842ddbcfb0101855f1bb7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:00.494078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73217b-d738-43b6-ae43-4d5ced18623f None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:00.494596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73217b-d738-43b6-ae43-4d5ced18623f None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:00.494596 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73217b-d738-43b6-ae43-4d5ced18623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:00.516825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-cc73217b-d738-43b6-ae43-4d5ced18623f None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:00.518172 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-cc73217b-d738-43b6-ae43-4d5ced18623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:00.585813 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1387/2778] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:00.594605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f139ad0-1ff9-4efa-8f31-920b5b475e0b None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:00.594917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f139ad0-1ff9-4efa-8f31-920b5b475e0b None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:00.595195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f139ad0-1ff9-4efa-8f31-920b5b475e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:00.617146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-4f139ad0-1ff9-4efa-8f31-920b5b475e0b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:00.618599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-4f139ad0-1ff9-4efa-8f31-920b5b475e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:00.631193 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1392/2779] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:00.636374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73217b-d738-43b6-ae43-4d5ced18623f None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:00.648435 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73217b-d738-43b6-ae43-4d5ced18623f None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:00.654713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba5aaa-30ed-4693-82ab-d36c27942677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:00.655337 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba5aaa-30ed-4693-82ab-d36c27942677 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:00.656350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba5aaa-30ed-4693-82ab-d36c27942677 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:00.656658 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba5aaa-30ed-4693-82ab-d36c27942677 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:00.657320 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba5aaa-30ed-4693-82ab-d36c27942677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:05:00.657626 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba5aaa-30ed-4693-82ab-d36c27942677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:00.659513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba5aaa-30ed-4693-82ab-d36c27942677 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:00.673081 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1388/2780] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:05:00.678539 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f139ad0-1ff9-4efa-8f31-920b5b475e0b None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:00.689679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f139ad0-1ff9-4efa-8f31-920b5b475e0b None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:00.694938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603edb6-269b-4650-a8ce-54f023ae0468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:00.695566 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603edb6-269b-4650-a8ce-54f023ae0468 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:00.695849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603edb6-269b-4650-a8ce-54f023ae0468 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:00.696116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603edb6-269b-4650-a8ce-54f023ae0468 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:00.697065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603edb6-269b-4650-a8ce-54f023ae0468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:00.699833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603edb6-269b-4650-a8ce-54f023ae0468 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:00.774829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1393/2781] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:00 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:00.781085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba5aaa-30ed-4693-82ab-d36c27942677 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:00.794871 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba5aaa-30ed-4693-82ab-d36c27942677 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:00.875308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256c4f9-f3d4-4a69-89dd-5cddd580df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:00.876252 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256c4f9-f3d4-4a69-89dd-5cddd580df58 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:00.876706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256c4f9-f3d4-4a69-89dd-5cddd580df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:00.877087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256c4f9-f3d4-4a69-89dd-5cddd580df58 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:00.879344 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256c4f9-f3d4-4a69-89dd-5cddd580df58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:00.881663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256c4f9-f3d4-4a69-89dd-5cddd580df58 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:00.971811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1389/2782] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:00 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:00.975979 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603edb6-269b-4650-a8ce-54f023ae0468 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:00.989388 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603edb6-269b-4650-a8ce-54f023ae0468 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:00.994918 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e19e10-13bd-4ba9-81d9-74439d9789b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:00.995696 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19e10-13bd-4ba9-81d9-74439d9789b3 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:00.996683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19e10-13bd-4ba9-81d9-74439d9789b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:00.996905 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19e10-13bd-4ba9-81d9-74439d9789b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:00.997683 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e19e10-13bd-4ba9-81d9-74439d9789b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:00.999375 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e19e10-13bd-4ba9-81d9-74439d9789b3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:01.010833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1394/2783] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:01.015511 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256c4f9-f3d4-4a69-89dd-5cddd580df58 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:01.029750 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256c4f9-f3d4-4a69-89dd-5cddd580df58 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:01.035930 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5a970-0674-4ad6-87b5-d9bad0eedfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:01.036743 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5a970-0674-4ad6-87b5-d9bad0eedfca admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:01.037148 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5a970-0674-4ad6-87b5-d9bad0eedfca admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:01.037663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5a970-0674-4ad6-87b5-d9bad0eedfca admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:01.038677 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5a970-0674-4ad6-87b5-d9bad0eedfca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:01.040371 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5a970-0674-4ad6-87b5-d9bad0eedfca admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:01.056125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1390/2784] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:01.057768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e19e10-13bd-4ba9-81d9-74439d9789b3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:01.070892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e19e10-13bd-4ba9-81d9-74439d9789b3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:01.076273 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7974413-a667-4a9d-acec-f3e7e9cc0fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:01.076974 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7974413-a667-4a9d-acec-f3e7e9cc0fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:01.077253 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7974413-a667-4a9d-acec-f3e7e9cc0fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:01.077522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7974413-a667-4a9d-acec-f3e7e9cc0fc2 admin admin] PATH_INFO: `/v3/projects/9e3b08e2816842fd89305b8833cc3940/users/86def54c37424037ad3ebd4f410cfa8a/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:01.098533 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7974413-a667-4a9d-acec-f3e7e9cc0fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3b08e2816842fd89305b8833cc3940, user_id=86def54c37424037ad3ebd4f410cfa8a, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:01.101652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7974413-a667-4a9d-acec-f3e7e9cc0fc2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:01.187270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1395/2785] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:01 2022] PUT /identity/v3/projects/9e3b08e2816842fd89305b8833cc3940/users/86def54c37424037ad3ebd4f410cfa8a/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:01.198791 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2784643-c4c4-49da-b923-59c7529ec8cc None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:01.199951 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2784643-c4c4-49da-b923-59c7529ec8cc None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:01.200217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2784643-c4c4-49da-b923-59c7529ec8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:01.242937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-f2784643-c4c4-49da-b923-59c7529ec8cc None None] MFA Rules not processed for user `86def54c37424037ad3ebd4f410cfa8a`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:01.244432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f2784643-c4c4-49da-b923-59c7529ec8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:01.266089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:01.326415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1391/2786] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:01.329003 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7974413-a667-4a9d-acec-f3e7e9cc0fc2 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:01.335600 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:01.402871 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7974413-a667-4a9d-acec-f3e7e9cc0fc2 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:01.407641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f3bea-bdef-4cb6-9647-ae4b948a75c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:01.408259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f3bea-bdef-4cb6-9647-ae4b948a75c5 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:01.408714 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f3bea-bdef-4cb6-9647-ae4b948a75c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:01.408989 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f3bea-bdef-4cb6-9647-ae4b948a75c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:01.409616 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f3bea-bdef-4cb6-9647-ae4b948a75c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:01.411562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f3bea-bdef-4cb6-9647-ae4b948a75c5 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:01.524325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1396/2787] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:01 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:01.530094 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2784643-c4c4-49da-b923-59c7529ec8cc None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:01.543319 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2784643-c4c4-49da-b923-59c7529ec8cc None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:01.614768 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e625c-74d7-4c5f-87f5-580637512761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:01.615769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e625c-74d7-4c5f-87f5-580637512761 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:01.616398 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e625c-74d7-4c5f-87f5-580637512761 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:01.616855 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e625c-74d7-4c5f-87f5-580637512761 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:01.617803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e625c-74d7-4c5f-87f5-580637512761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:01.620733 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e625c-74d7-4c5f-87f5-580637512761 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:01.732641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1392/2788] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:01 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:05:01.735658 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f3bea-bdef-4cb6-9647-ae4b948a75c5 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:01.754180 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f3bea-bdef-4cb6-9647-ae4b948a75c5 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:01.762263 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585a77e-91d4-484c-8a91-5d80a94e6046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:01.765849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a77e-91d4-484c-8a91-5d80a94e6046 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:01.766136 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a77e-91d4-484c-8a91-5d80a94e6046 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:01.766521 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a77e-91d4-484c-8a91-5d80a94e6046 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:01.767328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585a77e-91d4-484c-8a91-5d80a94e6046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:01.769319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585a77e-91d4-484c-8a91-5d80a94e6046 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:01.786800 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1397/2789] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:01.792556 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e625c-74d7-4c5f-87f5-580637512761 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:01.815255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e625c-74d7-4c5f-87f5-580637512761 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:01.831715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08c61-4e6d-444b-a94a-d534b1e387e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:01.831715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08c61-4e6d-444b-a94a-d534b1e387e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:01.831715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08c61-4e6d-444b-a94a-d534b1e387e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:01.831715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd08c61-4e6d-444b-a94a-d534b1e387e7 admin admin] PATH_INFO: `/v3/projects/1dfd8c7a30544c9997180ac5c525edc0/users/2a4eb8d6b41c4da39696b650a71aed17/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:01.853911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585a77e-91d4-484c-8a91-5d80a94e6046 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:01.860411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-6585a77e-91d4-484c-8a91-5d80a94e6046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:01.861654 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd08c61-4e6d-444b-a94a-d534b1e387e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfd8c7a30544c9997180ac5c525edc0, user_id=2a4eb8d6b41c4da39696b650a71aed17, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:01.864356 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd08c61-4e6d-444b-a94a-d534b1e387e7 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:01.879436 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585a77e-91d4-484c-8a91-5d80a94e6046 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:01.886719 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:01.891635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:01.891635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:01.891635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] PATH_INFO: `/v3/users/1c818108dd024e7cb3e752c015cd5c5b` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:01.891635 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c818108dd024e7cb3e752c015cd5c5b)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:01.892031 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:01.997729 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1393/2790] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:01 2022] PUT /identity/v3/projects/1dfd8c7a30544c9997180ac5c525edc0/users/2a4eb8d6b41c4da39696b650a71aed17/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:02.001682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08c61-4e6d-444b-a94a-d534b1e387e7 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:02.097757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd08c61-4e6d-444b-a94a-d534b1e387e7 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:02.102624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ba435-11d5-49de-9bdc-dd8ddfd307b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:02.103352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ba435-11d5-49de-9bdc-dd8ddfd307b6 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:02.103627 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ba435-11d5-49de-9bdc-dd8ddfd307b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:02.107388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ba435-11d5-49de-9bdc-dd8ddfd307b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:02.107388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ba435-11d5-49de-9bdc-dd8ddfd307b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:02.107388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ba435-11d5-49de-9bdc-dd8ddfd307b6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:02.117984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1394/2791] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:05:02.122708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ba435-11d5-49de-9bdc-dd8ddfd307b6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:02.136169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ba435-11d5-49de-9bdc-dd8ddfd307b6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:02.139558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d63215-f69d-4e25-b905-a463e0215deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:02.140237 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d63215-f69d-4e25-b905-a463e0215deb admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:02.140599 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d63215-f69d-4e25-b905-a463e0215deb admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:02.140808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d63215-f69d-4e25-b905-a463e0215deb admin admin] PATH_INFO: `/v3/projects/1dfd8c7a30544c9997180ac5c525edc0/users/2a4eb8d6b41c4da39696b650a71aed17/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:02.142830 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d63215-f69d-4e25-b905-a463e0215deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfd8c7a30544c9997180ac5c525edc0, user_id=2a4eb8d6b41c4da39696b650a71aed17, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:02.145576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d63215-f69d-4e25-b905-a463e0215deb admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:02.157370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1395/2792] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:02 2022] PUT /identity/v3/projects/1dfd8c7a30544c9997180ac5c525edc0/users/2a4eb8d6b41c4da39696b650a71aed17/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:05:02.175217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5f9fc-b854-4357-b3e6-f8f7f907eaa3 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:02.175217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5f9fc-b854-4357-b3e6-f8f7f907eaa3 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:02.175217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5f9fc-b854-4357-b3e6-f8f7f907eaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:02.219285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:02.234360 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-45a5f9fc-b854-4357-b3e6-f8f7f907eaa3 None None] MFA Rules not processed for user `2a4eb8d6b41c4da39696b650a71aed17`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:02.236928 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-45a5f9fc-b854-4357-b3e6-f8f7f907eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:02.275105 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c818108dd024e7cb3e752c015cd5c5b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:02.292173 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c818108dd024e7cb3e752c015cd5c5b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:02.381788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1396/2793] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:05:02.387196 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5f9fc-b854-4357-b3e6-f8f7f907eaa3 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:02.388941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-45a5f9fc-b854-4357-b3e6-f8f7f907eaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:02.402272 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c818108dd024e7cb3e752c015cd5c5b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:02.403224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c818108dd024e7cb3e752c015cd5c5b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:02.404040 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-b6357f15-f3b5-4296-9275-95a085e21c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c818108dd024e7cb3e752c015cd5c5b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:02.438498 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1398/2794] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:01 2022] DELETE /identity/v3/users/1c818108dd024e7cb3e752c015cd5c5b => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:02.440145 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4c43-e17e-45b3-9396-56253b52a201 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:02.440485 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4c43-e17e-45b3-9396-56253b52a201 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:02.440787 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4c43-e17e-45b3-9396-56253b52a201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:02.469413 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5f9fc-b854-4357-b3e6-f8f7f907eaa3 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:02.470707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-49ec4c43-e17e-45b3-9396-56253b52a201 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:02.472176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-49ec4c43-e17e-45b3-9396-56253b52a201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:02.533470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8479cd3-e3c1-4913-badb-7dce0087a653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:02.534129 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8479cd3-e3c1-4913-badb-7dce0087a653 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:02.534478 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8479cd3-e3c1-4913-badb-7dce0087a653 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:02.534762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8479cd3-e3c1-4913-badb-7dce0087a653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:02.537472 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:02.539280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f8479cd3-e3c1-4913-badb-7dce0087a653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:02.556863 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1399/2795] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:05:02.569425 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec4c43-e17e-45b3-9396-56253b52a201 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:02.571158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-49ec4c43-e17e-45b3-9396-56253b52a201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:02.618358 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8479cd3-e3c1-4913-badb-7dce0087a653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:02.619811 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8479cd3-e3c1-4913-badb-7dce0087a653 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:02.632408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1397/2796] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:05:02.643107 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=100 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:02.646550 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec4c43-e17e-45b3-9396-56253b52a201 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:02.657227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59899c9-d3a0-4b0b-a8be-f42adf980912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:02.657227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59899c9-d3a0-4b0b-a8be-f42adf980912 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:02.657227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59899c9-d3a0-4b0b-a8be-f42adf980912 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:02.657227 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59899c9-d3a0-4b0b-a8be-f42adf980912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:02.674618 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59899c9-d3a0-4b0b-a8be-f42adf980912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:02.676239 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59899c9-d3a0-4b0b-a8be-f42adf980912 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:02.697017 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1400/2797] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:03.043694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8479cd3-e3c1-4913-badb-7dce0087a653 service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:03.048655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f8479cd3-e3c1-4913-badb-7dce0087a653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:03.062302 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8479cd3-e3c1-4913-badb-7dce0087a653 service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:03.066593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508512f-f9b5-44fb-9f32-e0ea5826a37d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:03.071641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508512f-f9b5-44fb-9f32-e0ea5826a37d service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:03.071641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508512f-f9b5-44fb-9f32-e0ea5826a37d service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:03.071641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508512f-f9b5-44fb-9f32-e0ea5826a37d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:03.071641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3508512f-f9b5-44fb-9f32-e0ea5826a37d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:03.169290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508512f-f9b5-44fb-9f32-e0ea5826a37d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:03.171602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508512f-f9b5-44fb-9f32-e0ea5826a37d service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:03.189607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1398/2798] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:03.358939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59899c9-d3a0-4b0b-a8be-f42adf980912 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:03.360647 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b59899c9-d3a0-4b0b-a8be-f42adf980912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:03.398466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59899c9-d3a0-4b0b-a8be-f42adf980912 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:03.414348 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:03.415007 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:03.415341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:03.415668 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] PATH_INFO: `/v3/projects/4c4aca17c83e4d44add847f4a3222171` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:03.421851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4aca17c83e4d44add847f4a3222171)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:03.424115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:03.495262 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508512f-f9b5-44fb-9f32-e0ea5826a37d service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:03.496833 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3508512f-f9b5-44fb-9f32-e0ea5826a37d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:03.508985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508512f-f9b5-44fb-9f32-e0ea5826a37d service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:03.514326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced96f3b-9b21-4cc7-ad2a-7010cfc0c905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:03.515374 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced96f3b-9b21-4cc7-ad2a-7010cfc0c905 service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:03.515903 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced96f3b-9b21-4cc7-ad2a-7010cfc0c905 service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:03.516562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced96f3b-9b21-4cc7-ad2a-7010cfc0c905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:03.520169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ced96f3b-9b21-4cc7-ad2a-7010cfc0c905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:03.561736 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4aca17c83e4d44add847f4a3222171', 'request_id': 'req-858dee51-90e1-4b0d-a39a-4f60e0df60f4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:03.571124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4aca17c83e4d44add847f4a3222171', 'request_id': 'req-858dee51-90e1-4b0d-a39a-4f60e0df60f4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:03.603806 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4aca17c83e4d44add847f4a3222171', 'request_id': 'req-858dee51-90e1-4b0d-a39a-4f60e0df60f4'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:03.647227 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced96f3b-9b21-4cc7-ad2a-7010cfc0c905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:03.649043 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced96f3b-9b21-4cc7-ad2a-7010cfc0c905 service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:03.670415 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1399/2799] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:05:03.691321 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] The token cache is being invalidate because project 4c4aca17c83e4d44add847f4a3222171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:03.692028 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:03.693368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-858dee51-90e1-4b0d-a39a-4f60e0df60f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:03.696024 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1401/2800] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:03 2022] DELETE /identity/v3/projects/4c4aca17c83e4d44add847f4a3222171 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:03.702996 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7be43d-6648-48d5-a27c-7e359252806d None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:03.703205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7be43d-6648-48d5-a27c-7e359252806d None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:03.703368 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7be43d-6648-48d5-a27c-7e359252806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:03.724696 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-ad7be43d-6648-48d5-a27c-7e359252806d None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:03.725976 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ad7be43d-6648-48d5-a27c-7e359252806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:03.815022 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1400/2801] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:03.823523 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eecaa4-46fe-4a1e-8967-4b40f39065bd None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:03.827981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eecaa4-46fe-4a1e-8967-4b40f39065bd None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:03.827981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eecaa4-46fe-4a1e-8967-4b40f39065bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:03.854799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-02eecaa4-46fe-4a1e-8967-4b40f39065bd None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:03.857434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-02eecaa4-46fe-4a1e-8967-4b40f39065bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:03.872466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1402/2802] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:03.879137 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7be43d-6648-48d5-a27c-7e359252806d None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:03.891667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7be43d-6648-48d5-a27c-7e359252806d None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:03.895551 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb48b87-cc86-4d73-b65f-1dede0b68a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:03.896199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48b87-cc86-4d73-b65f-1dede0b68a50 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:03.896465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48b87-cc86-4d73-b65f-1dede0b68a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:03.896770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb48b87-cc86-4d73-b65f-1dede0b68a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:03.897612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb48b87-cc86-4d73-b65f-1dede0b68a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:05:03.897981 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb48b87-cc86-4d73-b65f-1dede0b68a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:03.899645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb48b87-cc86-4d73-b65f-1dede0b68a50 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:03.912403 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1401/2803] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:05:03.917651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eecaa4-46fe-4a1e-8967-4b40f39065bd None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:03.931079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eecaa4-46fe-4a1e-8967-4b40f39065bd None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:03.937791 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b75213-1315-48e0-b4aa-8785de07c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:03.938606 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b75213-1315-48e0-b4aa-8785de07c5ea admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:03.939032 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b75213-1315-48e0-b4aa-8785de07c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:03.939570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b75213-1315-48e0-b4aa-8785de07c5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:03.940880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b75213-1315-48e0-b4aa-8785de07c5ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:03.944423 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b75213-1315-48e0-b4aa-8785de07c5ea admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:03.989453 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb48b87-cc86-4d73-b65f-1dede0b68a50 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:03.998236 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2bb48b87-cc86-4d73-b65f-1dede0b68a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:04.027766 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb48b87-cc86-4d73-b65f-1dede0b68a50 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:04.035639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:04.036303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:04.036621 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:04.038688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] PATH_INFO: `/v3/users/7bcfec02574441788fe108cbe74d8c55` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:04.038688 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bcfec02574441788fe108cbe74d8c55)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:04.045442 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:04.069589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1403/2804] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:03 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:05:04.073356 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b75213-1315-48e0-b4aa-8785de07c5ea admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:04.078213 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:04.148567 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:04.162996 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b75213-1315-48e0-b4aa-8785de07c5ea admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:04.167920 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b52e3-8f46-499f-b92e-1fa6dbab8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:04.168571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b52e3-8f46-499f-b92e-1fa6dbab8c2d admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:04.168850 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b52e3-8f46-499f-b92e-1fa6dbab8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:04.171966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b52e3-8f46-499f-b92e-1fa6dbab8c2d admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:04.171966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b52e3-8f46-499f-b92e-1fa6dbab8c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:04.171966 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b52e3-8f46-499f-b92e-1fa6dbab8c2d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:04.282034 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1404/2805] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:04 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:05:04.283546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b52e3-8f46-499f-b92e-1fa6dbab8c2d admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:04.293994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b52e3-8f46-499f-b92e-1fa6dbab8c2d admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:04.298669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9a67d-e954-45d8-8263-f802178e29b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:04.299270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9a67d-e954-45d8-8263-f802178e29b2 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:04.299546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9a67d-e954-45d8-8263-f802178e29b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:04.299815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9a67d-e954-45d8-8263-f802178e29b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:04.300446 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9a67d-e954-45d8-8263-f802178e29b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:04.302087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9a67d-e954-45d8-8263-f802178e29b2 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:04.316033 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1405/2806] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:05:04.320286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9a67d-e954-45d8-8263-f802178e29b2 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:04.331562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bcfec02574441788fe108cbe74d8c55'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:04.338584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9a67d-e954-45d8-8263-f802178e29b2 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:04.339810 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa90b60-72ae-44aa-8ad0-87e0be1b1b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:04.340595 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa90b60-72ae-44aa-8ad0-87e0be1b1b93 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:04.340881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa90b60-72ae-44aa-8ad0-87e0be1b1b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:04.341221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa90b60-72ae-44aa-8ad0-87e0be1b1b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:04.342099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa90b60-72ae-44aa-8ad0-87e0be1b1b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:04.343934 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa90b60-72ae-44aa-8ad0-87e0be1b1b93 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:04.348479 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bcfec02574441788fe108cbe74d8c55'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:04.356637 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1406/2807] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:05:04.360898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa90b60-72ae-44aa-8ad0-87e0be1b1b93 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:04.372352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa90b60-72ae-44aa-8ad0-87e0be1b1b93 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:04.377584 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603a0f8-11d5-4d3d-bd4a-07bc39a24c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:04.378254 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a0f8-11d5-4d3d-bd4a-07bc39a24c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:04.378531 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a0f8-11d5-4d3d-bd4a-07bc39a24c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:04.378793 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a0f8-11d5-4d3d-bd4a-07bc39a24c92 admin admin] PATH_INFO: `/v3/projects/a9a2a70aea2540a9a01ac39aecb4dbff/users/ddfb0e013832444aaffec876a1d7ed1e/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:04.396564 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603a0f8-11d5-4d3d-bd4a-07bc39a24c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a2a70aea2540a9a01ac39aecb4dbff, user_id=ddfb0e013832444aaffec876a1d7ed1e, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:04.399223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603a0f8-11d5-4d3d-bd4a-07bc39a24c92 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:04.470734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bcfec02574441788fe108cbe74d8c55'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:04.471393 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bcfec02574441788fe108cbe74d8c55'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:04.481017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bcfec02574441788fe108cbe74d8c55'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:04.485224 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1407/2808] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:04 2022] PUT /identity/v3/projects/a9a2a70aea2540a9a01ac39aecb4dbff/users/ddfb0e013832444aaffec876a1d7ed1e/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:05:04.488282 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1402/2809] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:03 2022] DELETE /identity/v3/users/7bcfec02574441788fe108cbe74d8c55 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:04.504945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858cec5-215a-4983-9386-f0ecf409a3e0 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:04.505278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858cec5-215a-4983-9386-f0ecf409a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:04.505743 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858cec5-215a-4983-9386-f0ecf409a3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:04.538513 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0858cec5-215a-4983-9386-f0ecf409a3e0 None None] MFA Rules not processed for user `ddfb0e013832444aaffec876a1d7ed1e`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:04.539752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0858cec5-215a-4983-9386-f0ecf409a3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:04.659553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1408/2810] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:05:04.664142 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:04.667512 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:04.742285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c291216-1481-442e-83d8-ac36c5108e14 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:04.747749 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f700ad-066e-488f-baee-3e93b5e4e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:04.748397 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f700ad-066e-488f-baee-3e93b5e4e947 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:04.748714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f700ad-066e-488f-baee-3e93b5e4e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:04.748992 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f700ad-066e-488f-baee-3e93b5e4e947 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:04.749634 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f700ad-066e-488f-baee-3e93b5e4e947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:04.751562 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f700ad-066e-488f-baee-3e93b5e4e947 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:04.775000 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858cec5-215a-4983-9386-f0ecf409a3e0 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:04.776604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0858cec5-215a-4983-9386-f0ecf409a3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:04.794146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858cec5-215a-4983-9386-f0ecf409a3e0 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:04.799541 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:04.800453 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:04.801008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:04.801256 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] PATH_INFO: `/v3/projects/31422c1902e24bebb96960aff0ad4dc3` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:04.803930 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31422c1902e24bebb96960aff0ad4dc3)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:04.804636 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:04.835421 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1403/2811] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:04 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:04.836681 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f700ad-066e-488f-baee-3e93b5e4e947 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:04.901698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f700ad-066e-488f-baee-3e93b5e4e947 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:04.907006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6183dae-6d2a-4caf-929c-63c0728dbb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:04.907624 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6183dae-6d2a-4caf-929c-63c0728dbb2b admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:04.907903 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6183dae-6d2a-4caf-929c-63c0728dbb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:04.908175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6183dae-6d2a-4caf-929c-63c0728dbb2b admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:04.908840 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6183dae-6d2a-4caf-929c-63c0728dbb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:04.910779 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6183dae-6d2a-4caf-929c-63c0728dbb2b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:04.962700 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31422c1902e24bebb96960aff0ad4dc3', 'request_id': 'req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:04.969910 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31422c1902e24bebb96960aff0ad4dc3', 'request_id': 'req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:04.976710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31422c1902e24bebb96960aff0ad4dc3', 'request_id': 'req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:05.022869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1404/2812] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:04 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:05:05.025228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6183dae-6d2a-4caf-929c-63c0728dbb2b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:05.036346 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6183dae-6d2a-4caf-929c-63c0728dbb2b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:05.040104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:05.061393 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] The token cache is being invalidate because project 31422c1902e24bebb96960aff0ad4dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:05.061692 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:05.062377 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:05.064413 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1409/2813] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:04 2022] DELETE /identity/v3/projects/31422c1902e24bebb96960aff0ad4dc3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:05:05.068889 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:05.074319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:05.082345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:05.115619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bf37e-6eeb-4ca9-a347-1db41d8b0910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:05.116614 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf37e-6eeb-4ca9-a347-1db41d8b0910 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:05.116881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf37e-6eeb-4ca9-a347-1db41d8b0910 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:05.117253 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7bf37e-6eeb-4ca9-a347-1db41d8b0910 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:05.117966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bf37e-6eeb-4ca9-a347-1db41d8b0910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:05.119796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7bf37e-6eeb-4ca9-a347-1db41d8b0910 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:05.133798 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1405/2814] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:05.140567 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bf37e-6eeb-4ca9-a347-1db41d8b0910 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:05.153987 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5f7bf37e-6eeb-4ca9-a347-1db41d8b0910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:05.171558 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7bf37e-6eeb-4ca9-a347-1db41d8b0910 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:05.177612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea255ac8-0f68-43fd-b6e7-c66e119dd7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:05.178663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea255ac8-0f68-43fd-b6e7-c66e119dd7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:05.178663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea255ac8-0f68-43fd-b6e7-c66e119dd7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:05.179304 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea255ac8-0f68-43fd-b6e7-c66e119dd7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:05.179529 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea255ac8-0f68-43fd-b6e7-c66e119dd7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:05.181526 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea255ac8-0f68-43fd-b6e7-c66e119dd7b6 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:05.195112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1406/2815] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:05.200290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea255ac8-0f68-43fd-b6e7-c66e119dd7b6 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:05.207372 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f4cc9-b7c1-4cd0-8aca-2f51f7404238 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:05.214109 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:05.214338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea255ac8-0f68-43fd-b6e7-c66e119dd7b6 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:05.215789 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:05.216260 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:05.216733 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] PATH_INFO: `/v3/users/0f7f3e56b743458f8a1a3e1242700a01` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:05.218233 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7f3e56b743458f8a1a3e1242700a01)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:05.220577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:05.222473 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505727e4-9f3f-482f-ba62-ea956ae28c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:05.223430 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505727e4-9f3f-482f-ba62-ea956ae28c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:05.224020 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505727e4-9f3f-482f-ba62-ea956ae28c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:05.224488 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505727e4-9f3f-482f-ba62-ea956ae28c55 admin admin] PATH_INFO: `/v3/projects/494b94d2e62847aeb3202f227f0f746b/users/d8f3d5e8f633413d8aba11d761bd659c/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:05.244665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505727e4-9f3f-482f-ba62-ea956ae28c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494b94d2e62847aeb3202f227f0f746b, user_id=d8f3d5e8f633413d8aba11d761bd659c, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:05.246774 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505727e4-9f3f-482f-ba62-ea956ae28c55 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:05.305058 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1407/2816] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:05 2022] PUT /identity/v3/projects/494b94d2e62847aeb3202f227f0f746b/users/d8f3d5e8f633413d8aba11d761bd659c/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:05.316072 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f0ac-a4d0-4973-b59b-e17ed1b2c096 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:05.316353 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f0ac-a4d0-4973-b59b-e17ed1b2c096 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:05.316662 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f0ac-a4d0-4973-b59b-e17ed1b2c096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:05.346858 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-2536f0ac-a4d0-4973-b59b-e17ed1b2c096 None None] MFA Rules not processed for user `d8f3d5e8f633413d8aba11d761bd659c`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:05.348071 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2536f0ac-a4d0-4973-b59b-e17ed1b2c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:05.413445 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1408/2817] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:05:05.417943 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536f0ac-a4d0-4973-b59b-e17ed1b2c096 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:05.442571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7f3e56b743458f8a1a3e1242700a01'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:05.452363 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7f3e56b743458f8a1a3e1242700a01'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:05.483530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:05.487560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536f0ac-a4d0-4973-b59b-e17ed1b2c096 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:05.492187 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3961f-7047-4c98-9a37-32b7ad68b20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:05.492828 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3961f-7047-4c98-9a37-32b7ad68b20e admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:05.493104 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3961f-7047-4c98-9a37-32b7ad68b20e admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:05.493376 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3961f-7047-4c98-9a37-32b7ad68b20e admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:05.493997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3961f-7047-4c98-9a37-32b7ad68b20e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:05.496378 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3961f-7047-4c98-9a37-32b7ad68b20e admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:05.573664 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7f3e56b743458f8a1a3e1242700a01'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:05.575013 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7f3e56b743458f8a1a3e1242700a01'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:05.575633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7f3e56b743458f8a1a3e1242700a01'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:05.597594 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1410/2818] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:05 2022] DELETE /identity/v3/users/0f7f3e56b743458f8a1a3e1242700a01 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:05:05.610762 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1409/2819] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:05 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:05:05.620712 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:05.623045 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:05.720025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8b62c-d32f-4053-90fd-ae572e156cfb admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:05.760950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:05.790166 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20124680-9351-4dd7-b25b-c1eabd7b0817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:05.790779 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124680-9351-4dd7-b25b-c1eabd7b0817 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:05.791087 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124680-9351-4dd7-b25b-c1eabd7b0817 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:05.791385 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124680-9351-4dd7-b25b-c1eabd7b0817 admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:05.792200 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20124680-9351-4dd7-b25b-c1eabd7b0817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:05.795786 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20124680-9351-4dd7-b25b-c1eabd7b0817 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:05.983156 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3961f-7047-4c98-9a37-32b7ad68b20e admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:05.985169 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2de3961f-7047-4c98-9a37-32b7ad68b20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:05.989419 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1411/2820] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:05 2022] POST /identity/v3/users => generated 298 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:05.994610 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20124680-9351-4dd7-b25b-c1eabd7b0817 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:06.004810 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3961f-7047-4c98-9a37-32b7ad68b20e admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:06.010118 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:06.010887 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.011231 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.011578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] PATH_INFO: `/v3/projects/1c9f631621364962a53e6d5e4271b2a0` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.013108 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20124680-9351-4dd7-b25b-c1eabd7b0817 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:06.013516 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c9f631621364962a53e6d5e4271b2a0)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:06.015619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:06.021141 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c348048-b90c-426b-b088-19107920c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:06.021951 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c348048-b90c-426b-b088-19107920c572 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.022438 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c348048-b90c-426b-b088-19107920c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.022898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c348048-b90c-426b-b088-19107920c572 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.024107 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c348048-b90c-426b-b088-19107920c572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:06.027585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c348048-b90c-426b-b088-19107920c572 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:06.042477 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1412/2821] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:06.047990 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c348048-b90c-426b-b088-19107920c572 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:06.059780 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c348048-b90c-426b-b088-19107920c572 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:06.065008 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71e2db-65b0-4d08-9287-d4dab1d4e0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:06.065677 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71e2db-65b0-4d08-9287-d4dab1d4e0c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.065961 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71e2db-65b0-4d08-9287-d4dab1d4e0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.066231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71e2db-65b0-4d08-9287-d4dab1d4e0c7 admin admin] PATH_INFO: `/v3/projects/663605e055a4423cab0303ea6669e077/users/2d0a1c60d39540c9a3b1634e0dc6d332/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.085519 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71e2db-65b0-4d08-9287-d4dab1d4e0c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663605e055a4423cab0303ea6669e077, user_id=2d0a1c60d39540c9a3b1634e0dc6d332, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:06.088689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71e2db-65b0-4d08-9287-d4dab1d4e0c7 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:06.189134 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1413/2822] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:06 2022] PUT /identity/v3/projects/663605e055a4423cab0303ea6669e077/users/2d0a1c60d39540c9a3b1634e0dc6d332/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:06.193115 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71e2db-65b0-4d08-9287-d4dab1d4e0c7 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:06.206267 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c9f631621364962a53e6d5e4271b2a0', 'request_id': 'req-a2cb0536-2133-4780-a1cb-b074b61697dc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:06.279877 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71e2db-65b0-4d08-9287-d4dab1d4e0c7 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:06.293825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c9f631621364962a53e6d5e4271b2a0', 'request_id': 'req-a2cb0536-2133-4780-a1cb-b074b61697dc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:06.308035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c9f631621364962a53e6d5e4271b2a0', 'request_id': 'req-a2cb0536-2133-4780-a1cb-b074b61697dc'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:06.318518 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] The token cache is being invalidate because project 1c9f631621364962a53e6d5e4271b2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:06.318960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:06.319704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:06.321944 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1410/2823] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:05 2022] DELETE /identity/v3/projects/1c9f631621364962a53e6d5e4271b2a0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:05:06.353849 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a1ae4-383b-416d-8efa-32dfd81371af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:06.354510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1ae4-383b-416d-8efa-32dfd81371af admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.354798 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1ae4-383b-416d-8efa-32dfd81371af admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.355072 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1ae4-383b-416d-8efa-32dfd81371af admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.356308 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a1ae4-383b-416d-8efa-32dfd81371af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:06.358041 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a1ae4-383b-416d-8efa-32dfd81371af admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:06.369724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1414/2824] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:06.374247 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:06.375759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:06.389628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb0536-2133-4780-a1cb-b074b61697dc admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:06.397644 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f564-f685-4d52-bc1c-9ae37f788dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:06.398353 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f564-f685-4d52-bc1c-9ae37f788dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.398639 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f564-f685-4d52-bc1c-9ae37f788dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.398920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f564-f685-4d52-bc1c-9ae37f788dc8 admin admin] PATH_INFO: `/v3/projects/663605e055a4423cab0303ea6669e077/users/2d0a1c60d39540c9a3b1634e0dc6d332/roles/eeb6551eeb934053866fc821b511b5dd` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.402676 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2f564-f685-4d52-bc1c-9ae37f788dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663605e055a4423cab0303ea6669e077, user_id=2d0a1c60d39540c9a3b1634e0dc6d332, role_id=eeb6551eeb934053866fc821b511b5dd)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:06.405743 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2f564-f685-4d52-bc1c-9ae37f788dc8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:06.419730 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1411/2825] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:06 2022] PUT /identity/v3/projects/663605e055a4423cab0303ea6669e077/users/2d0a1c60d39540c9a3b1634e0dc6d332/roles/eeb6551eeb934053866fc821b511b5dd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:06.435244 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133fa78-a023-4ec0-a081-1bb80b404040 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.436710 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133fa78-a023-4ec0-a081-1bb80b404040 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.440828 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133fa78-a023-4ec0-a081-1bb80b404040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.489392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-5133fa78-a023-4ec0-a081-1bb80b404040 None None] MFA Rules not processed for user `2d0a1c60d39540c9a3b1634e0dc6d332`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:06.490588 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5133fa78-a023-4ec0-a081-1bb80b404040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:06.511723 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:06.611319 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1415/2826] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:06.631537 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f564-f685-4d52-bc1c-9ae37f788dc8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:06.634295 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-03c2f564-f685-4d52-bc1c-9ae37f788dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:06.712565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f564-f685-4d52-bc1c-9ae37f788dc8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:06.717130 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834ec3a-6285-4a60-abd7-2771bed2345e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:06.717761 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834ec3a-6285-4a60-abd7-2771bed2345e service cinder] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.718039 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834ec3a-6285-4a60-abd7-2771bed2345e service cinder] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.718312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834ec3a-6285-4a60-abd7-2771bed2345e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.720146 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5834ec3a-6285-4a60-abd7-2771bed2345e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:06.784087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834ec3a-6285-4a60-abd7-2771bed2345e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:06.785587 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834ec3a-6285-4a60-abd7-2771bed2345e service cinder] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:06.798784 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1412/2827] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:09.021318 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133fa78-a023-4ec0-a081-1bb80b404040 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:09.023651 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5133fa78-a023-4ec0-a081-1bb80b404040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:09.036957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133fa78-a023-4ec0-a081-1bb80b404040 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:09.040799 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413330ca-a409-4e1e-a200-6e995d0f95ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:09.041408 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413330ca-a409-4e1e-a200-6e995d0f95ac service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:09.041740 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413330ca-a409-4e1e-a200-6e995d0f95ac service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:09.042011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413330ca-a409-4e1e-a200-6e995d0f95ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:09.044343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-413330ca-a409-4e1e-a200-6e995d0f95ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:09.115101 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413330ca-a409-4e1e-a200-6e995d0f95ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:09.116591 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413330ca-a409-4e1e-a200-6e995d0f95ac service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:09.128464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1416/2828] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:10.346622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834ec3a-6285-4a60-abd7-2771bed2345e service cinder] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:10.348331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-5834ec3a-6285-4a60-abd7-2771bed2345e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:10.358801 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:10.419425 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834ec3a-6285-4a60-abd7-2771bed2345e service cinder] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:10.424163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:10.424844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:10.425125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:10.425399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] PATH_INFO: `/v3/users/86def54c37424037ad3ebd4f410cfa8a` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:10.426630 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=86def54c37424037ad3ebd4f410cfa8a)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:10.428631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:10.581195 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86def54c37424037ad3ebd4f410cfa8a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:10.593423 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86def54c37424037ad3ebd4f410cfa8a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:10.676217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86def54c37424037ad3ebd4f410cfa8a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:10.676910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86def54c37424037ad3ebd4f410cfa8a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:10.686619 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86def54c37424037ad3ebd4f410cfa8a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:10.697217 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1413/2829] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:10 2022] DELETE /identity/v3/users/86def54c37424037ad3ebd4f410cfa8a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:10.701836 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a184a-a556-4ac4-a784-78cdc357b1f7 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:10.702352 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a184a-a556-4ac4-a784-78cdc357b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:10.702463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a184a-a556-4ac4-a784-78cdc357b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:10.723957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3a4a184a-a556-4ac4-a784-78cdc357b1f7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:10.725603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3a4a184a-a556-4ac4-a784-78cdc357b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:10.785904 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1417/2830] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:10.796645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:10.798101 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:10.858030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450dd55-9571-42d9-b377-aa3243a7e91d admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:10.861655 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbc5e1-c25b-4103-9a03-6c801be8e60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:10.862328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbc5e1-c25b-4103-9a03-6c801be8e60b service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:10.862716 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbc5e1-c25b-4103-9a03-6c801be8e60b service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:10.862985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbc5e1-c25b-4103-9a03-6c801be8e60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:10.872375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbc5e1-c25b-4103-9a03-6c801be8e60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:10.873949 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbc5e1-c25b-4103-9a03-6c801be8e60b service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:10.883926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1414/2831] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:11.054217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a184a-a556-4ac4-a784-78cdc357b1f7 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:11.055604 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3a4a184a-a556-4ac4-a784-78cdc357b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:11.127270 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a184a-a556-4ac4-a784-78cdc357b1f7 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:11.131759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959767-f6d1-419b-a4eb-0087e1166ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:11.131759 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959767-f6d1-419b-a4eb-0087e1166ceb service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:11.132011 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959767-f6d1-419b-a4eb-0087e1166ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:11.132285 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959767-f6d1-419b-a4eb-0087e1166ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:11.134113 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-ab959767-f6d1-419b-a4eb-0087e1166ceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:11.141009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=100 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:11.209151 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab959767-f6d1-419b-a4eb-0087e1166ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:11.211322 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab959767-f6d1-419b-a4eb-0087e1166ceb service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:11.224583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1418/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:11.354153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbc5e1-c25b-4103-9a03-6c801be8e60b service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:11.354153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-3acbc5e1-c25b-4103-9a03-6c801be8e60b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:11.370748 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbc5e1-c25b-4103-9a03-6c801be8e60b service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:11.376505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:11.377173 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:11.377432 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:11.377713 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] PATH_INFO: `/v3/projects/9e3b08e2816842fd89305b8833cc3940` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:11.378864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3b08e2816842fd89305b8833cc3940)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:11.380820 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:11.407347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:11.502910 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3b08e2816842fd89305b8833cc3940', 'request_id': 'req-afd0c842-cacf-4ad5-adf5-301065529871'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:11.572994 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3b08e2816842fd89305b8833cc3940', 'request_id': 'req-afd0c842-cacf-4ad5-adf5-301065529871'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:11.580865 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3b08e2816842fd89305b8833cc3940', 'request_id': 'req-afd0c842-cacf-4ad5-adf5-301065529871'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:11.592788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] The token cache is being invalidate because project 9e3b08e2816842fd89305b8833cc3940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:11.593080 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:11.593787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:11.595271 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1415/2833] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:11 2022] DELETE /identity/v3/projects/9e3b08e2816842fd89305b8833cc3940 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:11.599685 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959767-f6d1-419b-a4eb-0087e1166ceb service cinder] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:11.610694 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959767-f6d1-419b-a4eb-0087e1166ceb service cinder] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:11.673105 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:11.673882 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:11.674198 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:11.674441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] PATH_INFO: `/v3/users/2a4eb8d6b41c4da39696b650a71aed17` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:11.675599 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4eb8d6b41c4da39696b650a71aed17)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:11.677669 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:11.908155 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4eb8d6b41c4da39696b650a71aed17'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:11.915221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4eb8d6b41c4da39696b650a71aed17'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:11.984493 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4eb8d6b41c4da39696b650a71aed17'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:11.985173 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4eb8d6b41c4da39696b650a71aed17'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:11.985744 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3178a097-522a-4c30-80ce-0addac2af9db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4eb8d6b41c4da39696b650a71aed17'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:12.004816 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1419/2834] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:11 2022] DELETE /identity/v3/users/2a4eb8d6b41c4da39696b650a71aed17 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:12.449472 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:12.451310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:12.472993 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0c842-cacf-4ad5-adf5-301065529871 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:12.533507 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:12.534138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:12.534412 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:12.534683 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] PATH_INFO: `/v3/projects/1dfd8c7a30544c9997180ac5c525edc0` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:12.535793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dfd8c7a30544c9997180ac5c525edc0)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:12.537723 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:12.656549 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dfd8c7a30544c9997180ac5c525edc0', 'request_id': 'req-6874974e-15cf-42b7-a2c9-e2e29982b61d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:12.733411 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dfd8c7a30544c9997180ac5c525edc0', 'request_id': 'req-6874974e-15cf-42b7-a2c9-e2e29982b61d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:12.740704 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dfd8c7a30544c9997180ac5c525edc0', 'request_id': 'req-6874974e-15cf-42b7-a2c9-e2e29982b61d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:12.758133 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] The token cache is being invalidate because project 1dfd8c7a30544c9997180ac5c525edc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:12.758593 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:12.759089 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-6874974e-15cf-42b7-a2c9-e2e29982b61d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:12.760706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1416/2835] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:12 2022] DELETE /identity/v3/projects/1dfd8c7a30544c9997180ac5c525edc0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:12.767047 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28fe7c-f8b1-4a6d-a33f-b84dbaa8a8fe None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:12.767195 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28fe7c-f8b1-4a6d-a33f-b84dbaa8a8fe None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:12.767682 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28fe7c-f8b1-4a6d-a33f-b84dbaa8a8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:12.788571 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-cd28fe7c-f8b1-4a6d-a33f-b84dbaa8a8fe None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:12.790146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-cd28fe7c-f8b1-4a6d-a33f-b84dbaa8a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:12.816491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:12.864563 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1420/2836] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:12.868375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98b13-1f3a-4684-b8eb-6ed71ca25270 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:12.868784 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98b13-1f3a-4684-b8eb-6ed71ca25270 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:12.869117 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98b13-1f3a-4684-b8eb-6ed71ca25270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:12.890363 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-aab98b13-1f3a-4684-b8eb-6ed71ca25270 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:12.891641 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-aab98b13-1f3a-4684-b8eb-6ed71ca25270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:12.900607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1417/2837] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:12.911176 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28fe7c-f8b1-4a6d-a33f-b84dbaa8a8fe None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:12.922099 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28fe7c-f8b1-4a6d-a33f-b84dbaa8a8fe None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:12.927173 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7450c-441e-405a-9c4e-a0eb7aad51f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:12.930880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7450c-441e-405a-9c4e-a0eb7aad51f3 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:12.930880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7450c-441e-405a-9c4e-a0eb7aad51f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:12.930880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7450c-441e-405a-9c4e-a0eb7aad51f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:12.930880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7450c-441e-405a-9c4e-a0eb7aad51f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:05:12.930880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7450c-441e-405a-9c4e-a0eb7aad51f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:12.930880 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7450c-441e-405a-9c4e-a0eb7aad51f3 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:12.948271 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1421/2838] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:05:12.949935 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab98b13-1f3a-4684-b8eb-6ed71ca25270 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:12.959891 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab98b13-1f3a-4684-b8eb-6ed71ca25270 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:12.964900 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb7241-ed3f-47e1-8d1c-ef0a672fe5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:12.965560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb7241-ed3f-47e1-8d1c-ef0a672fe5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:12.965907 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb7241-ed3f-47e1-8d1c-ef0a672fe5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:12.966175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb7241-ed3f-47e1-8d1c-ef0a672fe5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:12.966803 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb7241-ed3f-47e1-8d1c-ef0a672fe5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:12.968747 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb7241-ed3f-47e1-8d1c-ef0a672fe5a3 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:13.106623 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1418/2839] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:12 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:05:13.111064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7450c-441e-405a-9c4e-a0eb7aad51f3 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:13.121753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7450c-441e-405a-9c4e-a0eb7aad51f3 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:13.181746 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4082a5-e538-4cd9-81a8-c233d8211efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:13.182422 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4082a5-e538-4cd9-81a8-c233d8211efc admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:13.182761 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4082a5-e538-4cd9-81a8-c233d8211efc admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:13.183116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4082a5-e538-4cd9-81a8-c233d8211efc admin admin] PATH_INFO: `/v3/users` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:13.183763 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4082a5-e538-4cd9-81a8-c233d8211efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:13.196553 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4082a5-e538-4cd9-81a8-c233d8211efc admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:13.270896 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1422/2840] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:13 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:05:13.277597 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb7241-ed3f-47e1-8d1c-ef0a672fe5a3 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:13.288269 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb7241-ed3f-47e1-8d1c-ef0a672fe5a3 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:13.293997 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bb376-4ce8-4ad3-b81a-ab40fc478a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:13.294602 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bb376-4ce8-4ad3-b81a-ab40fc478a3c admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:13.294878 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bb376-4ce8-4ad3-b81a-ab40fc478a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:13.295149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bb376-4ce8-4ad3-b81a-ab40fc478a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:13.295802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bb376-4ce8-4ad3-b81a-ab40fc478a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:13.297605 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bb376-4ce8-4ad3-b81a-ab40fc478a3c admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:13.308335 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1419/2841] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:13.320603 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4082a5-e538-4cd9-81a8-c233d8211efc admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:13.332481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4082a5-e538-4cd9-81a8-c233d8211efc admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:13.337650 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267da3fe-41cf-4b05-9fd3-d08c687821d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:13.338278 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267da3fe-41cf-4b05-9fd3-d08c687821d0 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:13.338559 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267da3fe-41cf-4b05-9fd3-d08c687821d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:13.338829 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267da3fe-41cf-4b05-9fd3-d08c687821d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:13.340190 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267da3fe-41cf-4b05-9fd3-d08c687821d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:13.342182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267da3fe-41cf-4b05-9fd3-d08c687821d0 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:13.356002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1423/2842] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:13.360309 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bb376-4ce8-4ad3-b81a-ab40fc478a3c admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:13.366885 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:13.371197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bb376-4ce8-4ad3-b81a-ab40fc478a3c admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:13.375934 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d57c6-15c1-48e3-8184-831d0c0ad5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:13.376625 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d57c6-15c1-48e3-8184-831d0c0ad5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:13.376905 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d57c6-15c1-48e3-8184-831d0c0ad5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:13.377181 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d57c6-15c1-48e3-8184-831d0c0ad5c8 admin admin] PATH_INFO: `/v3/projects/bb62799270374c39a4fc898df07ca598/users/0c095566e877484c9d371ee751835fd0/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:13.392203 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d57c6-15c1-48e3-8184-831d0c0ad5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb62799270374c39a4fc898df07ca598, user_id=0c095566e877484c9d371ee751835fd0, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:13.394894 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d57c6-15c1-48e3-8184-831d0c0ad5c8 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:13.466501 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1420/2843] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:13 2022] PUT /identity/v3/projects/bb62799270374c39a4fc898df07ca598/users/0c095566e877484c9d371ee751835fd0/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:05:13.478440 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50657137-4ff4-4326-b78a-b1c6ddb04021 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:13.478720 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50657137-4ff4-4326-b78a-b1c6ddb04021 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:13.478987 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50657137-4ff4-4326-b78a-b1c6ddb04021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:13.510807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-50657137-4ff4-4326-b78a-b1c6ddb04021 None None] MFA Rules not processed for user `0c095566e877484c9d371ee751835fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:13.512620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-50657137-4ff4-4326-b78a-b1c6ddb04021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:13.579203 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1424/2844] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:13.593440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d57c6-15c1-48e3-8184-831d0c0ad5c8 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:13.595198 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-374d57c6-15c1-48e3-8184-831d0c0ad5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:13.654581 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d57c6-15c1-48e3-8184-831d0c0ad5c8 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:13.658513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352d39c-e3df-4455-a490-fb87027c035c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2de83ba29194578a9a229d5bab6612e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:13.659150 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d39c-e3df-4455-a490-fb87027c035c service glance] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:13.659424 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d39c-e3df-4455-a490-fb87027c035c service glance] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:13.659693 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d39c-e3df-4455-a490-fb87027c035c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:13.669465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352d39c-e3df-4455-a490-fb87027c035c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:13.670932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352d39c-e3df-4455-a490-fb87027c035c service glance] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:13.680788 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1421/2845] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:16.118457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50657137-4ff4-4326-b78a-b1c6ddb04021 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:16.120327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-50657137-4ff4-4326-b78a-b1c6ddb04021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:16.142316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:16.203210 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50657137-4ff4-4326-b78a-b1c6ddb04021 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:16.208633 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:16.209269 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:16.209547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:16.209815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] PATH_INFO: `/v3/users/ddfb0e013832444aaffec876a1d7ed1e` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:16.211464 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddfb0e013832444aaffec876a1d7ed1e)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:16.212933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:16.353681 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddfb0e013832444aaffec876a1d7ed1e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:16.361481 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddfb0e013832444aaffec876a1d7ed1e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:16.413181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddfb0e013832444aaffec876a1d7ed1e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:16.413856 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddfb0e013832444aaffec876a1d7ed1e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:16.414459 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddfb0e013832444aaffec876a1d7ed1e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:16.433014 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1425/2846] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:16 2022] DELETE /identity/v3/users/ddfb0e013832444aaffec876a1d7ed1e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:16.437789 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384c70-ff8b-4a39-ad2b-9e30b79d9824 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:16.438384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384c70-ff8b-4a39-ad2b-9e30b79d9824 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:16.438384 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384c70-ff8b-4a39-ad2b-9e30b79d9824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:16.470585 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-09384c70-ff8b-4a39-ad2b-9e30b79d9824 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:16.471809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-09384c70-ff8b-4a39-ad2b-9e30b79d9824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:16.539088 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1422/2847] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:05:16.548994 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:16.556568 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:16.640739 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5bf0-4dd8-4e3b-8b94-137636749f1e admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:16.644583 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72b11-78b0-4552-b974-4f4166339a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:16.645221 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72b11-78b0-4552-b974-4f4166339a9d service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:16.645537 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72b11-78b0-4552-b974-4f4166339a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:16.645814 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72b11-78b0-4552-b974-4f4166339a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:16.655432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72b11-78b0-4552-b974-4f4166339a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:16.656957 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72b11-78b0-4552-b974-4f4166339a9d service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:16.669420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1426/2848] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:05:17.055682 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384c70-ff8b-4a39-ad2b-9e30b79d9824 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:17.057931 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-09384c70-ff8b-4a39-ad2b-9e30b79d9824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:17.071035 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384c70-ff8b-4a39-ad2b-9e30b79d9824 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:17.076353 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:17.077205 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:17.077544 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:17.078037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] PATH_INFO: `/v3/projects/a9a2a70aea2540a9a01ac39aecb4dbff` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:17.079322 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a2a70aea2540a9a01ac39aecb4dbff)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:17.081399 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:17.209642 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a2a70aea2540a9a01ac39aecb4dbff', 'request_id': 'req-208193ca-3392-45f2-9fa7-ee04ebe1772a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:17.272988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a2a70aea2540a9a01ac39aecb4dbff', 'request_id': 'req-208193ca-3392-45f2-9fa7-ee04ebe1772a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:17.282299 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a2a70aea2540a9a01ac39aecb4dbff', 'request_id': 'req-208193ca-3392-45f2-9fa7-ee04ebe1772a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:17.289429 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:17.295029 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] The token cache is being invalidate because project a9a2a70aea2540a9a01ac39aecb4dbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:17.295314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:17.296042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:17.297648 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1423/2849] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:17 2022] DELETE /identity/v3/projects/a9a2a70aea2540a9a01ac39aecb4dbff => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:17.301729 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72b11-78b0-4552-b974-4f4166339a9d service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:17.313196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72b11-78b0-4552-b974-4f4166339a9d service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:17.328009 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:17.375577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:17.376218 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:17.376499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:17.376841 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] PATH_INFO: `/v3/users/d8f3d5e8f633413d8aba11d761bd659c` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:17.377984 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f3d5e8f633413d8aba11d761bd659c)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:17.379909 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:17.566655 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f3d5e8f633413d8aba11d761bd659c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:17.574507 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f3d5e8f633413d8aba11d761bd659c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:17.665316 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f3d5e8f633413d8aba11d761bd659c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:17.666118 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f3d5e8f633413d8aba11d761bd659c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:17.666770 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f3d5e8f633413d8aba11d761bd659c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:17.685804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1427/2850] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:17 2022] DELETE /identity/v3/users/d8f3d5e8f633413d8aba11d761bd659c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:18.088945 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:18.090491 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:18.109869 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208193ca-3392-45f2-9fa7-ee04ebe1772a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:18.168753 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:18.169388 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:18.169663 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:18.169932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] PATH_INFO: `/v3/projects/494b94d2e62847aeb3202f227f0f746b` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:18.171050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494b94d2e62847aeb3202f227f0f746b)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:18.173031 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:18.271110 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494b94d2e62847aeb3202f227f0f746b', 'request_id': 'req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:18.333536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494b94d2e62847aeb3202f227f0f746b', 'request_id': 'req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:18.345326 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494b94d2e62847aeb3202f227f0f746b', 'request_id': 'req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:18.356881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] The token cache is being invalidate because project 494b94d2e62847aeb3202f227f0f746b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:18.357165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:18.357844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:18.359343 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1424/2851] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:18 2022] DELETE /identity/v3/projects/494b94d2e62847aeb3202f227f0f746b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:18.363939 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:18.365365 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:18.378678 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f9d1f-f032-4829-8091-e3da2ed62b3f admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:18.443259 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:18.443912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:18.444196 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:18.444474 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] PATH_INFO: `/v3/users/2d0a1c60d39540c9a3b1634e0dc6d332` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:18.445663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0a1c60d39540c9a3b1634e0dc6d332)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:18.447601 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:18.625335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:18.634345 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0a1c60d39540c9a3b1634e0dc6d332'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:18.643392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0a1c60d39540c9a3b1634e0dc6d332'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:18.744913 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0a1c60d39540c9a3b1634e0dc6d332'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:18.745851 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0a1c60d39540c9a3b1634e0dc6d332'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:18.746494 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0a1c60d39540c9a3b1634e0dc6d332'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:18.767060 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1428/2852] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:18 2022] DELETE /identity/v3/users/2d0a1c60d39540c9a3b1634e0dc6d332 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:19.289313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:19.290838 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:19.308843 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbccda-ed0d-46ec-bfe4-5c23bdb40509 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:19.376822 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:19.377630 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:19.377937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:19.378879 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] PATH_INFO: `/v3/projects/663605e055a4423cab0303ea6669e077` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:19.380135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] RBAC: Authorizing `identity:delete_project(project_id=663605e055a4423cab0303ea6669e077)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:19.382197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:19.457875 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:19.470808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663605e055a4423cab0303ea6669e077', 'request_id': 'req-731cb356-779c-46ab-9985-b5185cbd528a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:19.532574 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663605e055a4423cab0303ea6669e077', 'request_id': 'req-731cb356-779c-46ab-9985-b5185cbd528a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:19.539220 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663605e055a4423cab0303ea6669e077', 'request_id': 'req-731cb356-779c-46ab-9985-b5185cbd528a'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:19.550530 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] The token cache is being invalidate because project 663605e055a4423cab0303ea6669e077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:19.550821 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:19.551509 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:19.553037 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1425/2853] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:19 2022] DELETE /identity/v3/projects/663605e055a4423cab0303ea6669e077 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:25.957857 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:25.959371 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:26.054279 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbca31-6bcb-48fe-b244-1e48970911bd admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:26.123596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a3b01-fddd-44b2-b376-e9184d3b377a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecb4e7e9e3042adadd93229f8456eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:26.124246 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a3b01-fddd-44b2-b376-e9184d3b377a service placement] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:26.124547 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a3b01-fddd-44b2-b376-e9184d3b377a service placement] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:26.124824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a3b01-fddd-44b2-b376-e9184d3b377a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:26.126659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-f39a3b01-fddd-44b2-b376-e9184d3b377a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:26.138684 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a3b01-fddd-44b2-b376-e9184d3b377a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:26.140302 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a3b01-fddd-44b2-b376-e9184d3b377a service placement] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:26.151768 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1429/2854] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:28.111192 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:28.115496 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:28.186079 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cb356-779c-46ab-9985-b5185cbd528a admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:28.191470 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:28.192255 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:28.192565 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:28.192857 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] PATH_INFO: `/v3/users/d954426082884655a74bfda0b985045d` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:28.194111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d954426082884655a74bfda0b985045d)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:28.196194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:28.557459 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd954426082884655a74bfda0b985045d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:28.569513 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd954426082884655a74bfda0b985045d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:28.772548 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd954426082884655a74bfda0b985045d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:28.773194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd954426082884655a74bfda0b985045d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:28.781291 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd954426082884655a74bfda0b985045d'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:28.787700 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1426/2855] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:28 2022] DELETE /identity/v3/users/d954426082884655a74bfda0b985045d => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:29.175434 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a3b01-fddd-44b2-b376-e9184d3b377a service placement] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:29.187471 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a3b01-fddd-44b2-b376-e9184d3b377a service placement] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:29.219680 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:29.272120 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:29.272826 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:29.273107 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:29.273383 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] PATH_INFO: `/v3/projects/a164913768fc48349b5951d4997318fb` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:29.274752 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a164913768fc48349b5951d4997318fb)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:29.278050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:29.478286 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a164913768fc48349b5951d4997318fb', 'request_id': 'req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:29.484506 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a164913768fc48349b5951d4997318fb', 'request_id': 'req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:29.491617 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a164913768fc48349b5951d4997318fb', 'request_id': 'req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:29.624411 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] The token cache is being invalidate because project a164913768fc48349b5951d4997318fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:29.624758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:29.625420 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:29.626911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1430/2856] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:29 2022] DELETE /identity/v3/projects/a164913768fc48349b5951d4997318fb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:29.631520 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:29.633367 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:29.648135 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7b039-7719-4425-89d2-461959e6ee56 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:29.683576 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:29.707216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:29.707941 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:29.708226 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:29.708566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] PATH_INFO: `/v3/users/73ea27a8e1d64bdbbca079916a4c3934` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:29.709755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ea27a8e1d64bdbbca079916a4c3934)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:29.711787 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:29.977802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ea27a8e1d64bdbbca079916a4c3934'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:29.990170 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ea27a8e1d64bdbbca079916a4c3934'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:30.133216 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ea27a8e1d64bdbbca079916a4c3934'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:30.134285 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ea27a8e1d64bdbbca079916a4c3934'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:30.142230 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-88c59483-4a4d-4f6b-adc6-254658885026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ea27a8e1d64bdbbca079916a4c3934'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:30.149006 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1427/2857] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:29 2022] DELETE /identity/v3/users/73ea27a8e1d64bdbbca079916a4c3934 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:30.412499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:30.412499 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:30.429854 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aec7e-7d1e-4857-9be7-3c402111bb9c admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:30.494902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:30.496095 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.496374 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.496787 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] PATH_INFO: `/v3/projects/a1c5aad0571f4122a00370eeeccd8a75` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.497978 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c5aad0571f4122a00370eeeccd8a75)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:30.499932 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:30.650445 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c5aad0571f4122a00370eeeccd8a75', 'request_id': 'req-ac0ece8b-58b5-4400-8213-eed9506e8625'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:30.657522 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c5aad0571f4122a00370eeeccd8a75', 'request_id': 'req-ac0ece8b-58b5-4400-8213-eed9506e8625'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:30.658707 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:30.664706 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c5aad0571f4122a00370eeeccd8a75', 'request_id': 'req-ac0ece8b-58b5-4400-8213-eed9506e8625'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:30.757549 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] The token cache is being invalidate because project a1c5aad0571f4122a00370eeeccd8a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:30.757845 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:30.758538 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-ac0ece8b-58b5-4400-8213-eed9506e8625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:30.760147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1431/2858] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:30 2022] DELETE /identity/v3/projects/a1c5aad0571f4122a00370eeeccd8a75 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:05:30.766515 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af466d8-4bcc-4b04-84f0-97911e904ec7 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.767076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af466d8-4bcc-4b04-84f0-97911e904ec7 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.767076 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af466d8-4bcc-4b04-84f0-97911e904ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.822408 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-9af466d8-4bcc-4b04-84f0-97911e904ec7 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:30.824149 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-9af466d8-4bcc-4b04-84f0-97911e904ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:30.887163 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1428/2859] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:30.895818 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d839-fc81-44a8-bf7e-3bec9d3175af None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.896114 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d839-fc81-44a8-bf7e-3bec9d3175af None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.896463 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d839-fc81-44a8-bf7e-3bec9d3175af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.919746 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-62a3d839-fc81-44a8-bf7e-3bec9d3175af None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:30.921251 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-62a3d839-fc81-44a8-bf7e-3bec9d3175af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:30.930514 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1432/2860] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:30.935266 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af466d8-4bcc-4b04-84f0-97911e904ec7 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:30.945636 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af466d8-4bcc-4b04-84f0-97911e904ec7 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:30.950873 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b431d-dc43-4696-99ab-3d8dade67ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:30.951481 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b431d-dc43-4696-99ab-3d8dade67ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.951755 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b431d-dc43-4696-99ab-3d8dade67ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.952024 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b431d-dc43-4696-99ab-3d8dade67ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.952783 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b431d-dc43-4696-99ab-3d8dade67ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:05:30.953093 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b431d-dc43-4696-99ab-3d8dade67ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:30.954689 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b431d-dc43-4696-99ab-3d8dade67ed5 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:30.969881 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1429/2861] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:05:30.972025 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d839-fc81-44a8-bf7e-3bec9d3175af None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:30.983161 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d839-fc81-44a8-bf7e-3bec9d3175af None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:30.988338 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8acb3-d3c6-44c1-b4a9-3b8437760ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:30.989129 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8acb3-d3c6-44c1-b4a9-3b8437760ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.989283 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8acb3-d3c6-44c1-b4a9-3b8437760ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.989532 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8acb3-d3c6-44c1-b4a9-3b8437760ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.990147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8acb3-d3c6-44c1-b4a9-3b8437760ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:30.992063 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8acb3-d3c6-44c1-b4a9-3b8437760ca1 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:31.157093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1433/2862] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:30 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:31.161347 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b431d-dc43-4696-99ab-3d8dade67ed5 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:31.176070 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b431d-dc43-4696-99ab-3d8dade67ed5 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:31.192257 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:31.234938 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999bd5c-8889-4fb0-9a3c-1c879d1677d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:31.235560 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999bd5c-8889-4fb0-9a3c-1c879d1677d0 admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:31.235834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999bd5c-8889-4fb0-9a3c-1c879d1677d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:31.236106 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999bd5c-8889-4fb0-9a3c-1c879d1677d0 admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:31.236770 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999bd5c-8889-4fb0-9a3c-1c879d1677d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:31.238711 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999bd5c-8889-4fb0-9a3c-1c879d1677d0 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:31.547964 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1430/2863] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:31 2022] POST /identity/v3/users => generated 292 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:31.549328 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8acb3-d3c6-44c1-b4a9-3b8437760ca1 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:31.560981 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8acb3-d3c6-44c1-b4a9-3b8437760ca1 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:31.565811 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebab2-9621-4cae-8d3a-8e149228c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:31.566596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebab2-9621-4cae-8d3a-8e149228c220 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:31.566879 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebab2-9621-4cae-8d3a-8e149228c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:31.567181 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebab2-9621-4cae-8d3a-8e149228c220 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:31.567838 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ebab2-9621-4cae-8d3a-8e149228c220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:31.569491 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ebab2-9621-4cae-8d3a-8e149228c220 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:31.581911 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1434/2864] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:31.586297 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999bd5c-8889-4fb0-9a3c-1c879d1677d0 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:31.596818 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999bd5c-8889-4fb0-9a3c-1c879d1677d0 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:31.602087 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362712bc-73de-46ff-a9df-d92843ae6e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:31.602698 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362712bc-73de-46ff-a9df-d92843ae6e13 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:31.602977 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362712bc-73de-46ff-a9df-d92843ae6e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:31.603251 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362712bc-73de-46ff-a9df-d92843ae6e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:31.603901 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362712bc-73de-46ff-a9df-d92843ae6e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:31.606145 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362712bc-73de-46ff-a9df-d92843ae6e13 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:31.619234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1431/2865] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:31.624339 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebab2-9621-4cae-8d3a-8e149228c220 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:31.634561 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebab2-9621-4cae-8d3a-8e149228c220 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:31.639126 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ed444-5595-413f-8587-817cbb020d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:31.639777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ed444-5595-413f-8587-817cbb020d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:31.640056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ed444-5595-413f-8587-817cbb020d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:31.640327 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ed444-5595-413f-8587-817cbb020d5a admin admin] PATH_INFO: `/v3/projects/c1740b8e05774f909954aa4dcca52d5e/users/9e15fdf0527b46eabd8786c07e4bb9ea/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:31.655441 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ed444-5595-413f-8587-817cbb020d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1740b8e05774f909954aa4dcca52d5e, user_id=9e15fdf0527b46eabd8786c07e4bb9ea, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:31.658132 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ed444-5595-413f-8587-817cbb020d5a admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:31.848815 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1435/2866] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:31 2022] PUT /identity/v3/projects/c1740b8e05774f909954aa4dcca52d5e/users/9e15fdf0527b46eabd8786c07e4bb9ea/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:31.860834 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e609e-cd99-48a7-9467-47589c526fa9 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:31.861370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e609e-cd99-48a7-9467-47589c526fa9 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:31.861370 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e609e-cd99-48a7-9467-47589c526fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:31.890536 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-dc4e609e-cd99-48a7-9467-47589c526fa9 None None] MFA Rules not processed for user `9e15fdf0527b46eabd8786c07e4bb9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:31.891826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-dc4e609e-cd99-48a7-9467-47589c526fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:31.960808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1432/2867] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:31.972679 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ed444-5595-413f-8587-817cbb020d5a admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:31.974449 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-008ed444-5595-413f-8587-817cbb020d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:32.036039 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ed444-5595-413f-8587-817cbb020d5a admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:32.036378 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aaef9-5065-452f-848d-17bf8f040b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:32.037068 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aaef9-5065-452f-848d-17bf8f040b15 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:32.037340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aaef9-5065-452f-848d-17bf8f040b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:32.037608 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aaef9-5065-452f-848d-17bf8f040b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:32.047163 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aaef9-5065-452f-848d-17bf8f040b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:32.048693 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2aaef9-5065-452f-848d-17bf8f040b15 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:32.058182 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1436/2868] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:05:36.079734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e609e-cd99-48a7-9467-47589c526fa9 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:36.154842 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e609e-cd99-48a7-9467-47589c526fa9 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:36.159538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:36.160175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:36.160451 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:36.160746 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] PATH_INFO: `/v3/users/9e15fdf0527b46eabd8786c07e4bb9ea` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:36.161909 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e15fdf0527b46eabd8786c07e4bb9ea)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:36.163860 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:36.522566 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:36.537131 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e15fdf0527b46eabd8786c07e4bb9ea'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:36.551313 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e15fdf0527b46eabd8786c07e4bb9ea'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:36.693120 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e15fdf0527b46eabd8786c07e4bb9ea'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:36.693359 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e15fdf0527b46eabd8786c07e4bb9ea'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:36.702228 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e15fdf0527b46eabd8786c07e4bb9ea'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:36.708563 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1433/2869] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:36 2022] DELETE /identity/v3/users/9e15fdf0527b46eabd8786c07e4bb9ea => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:36.713147 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ad2ba-f3a2-47ba-9d2a-ebfdada40238 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:36.714297 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ad2ba-f3a2-47ba-9d2a-ebfdada40238 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:36.714401 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ad2ba-f3a2-47ba-9d2a-ebfdada40238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:36.733777 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-0b9ad2ba-f3a2-47ba-9d2a-ebfdada40238 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:36.734970 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0b9ad2ba-f3a2-47ba-9d2a-ebfdada40238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:36.800824 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1437/2870] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:36.811757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:36.813300 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:36.918919 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd15e0e-a1a8-4406-9dae-48be3b5ee801 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:36.923790 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df336e5-1c58-4d9e-88ec-332f45447f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:36.924428 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df336e5-1c58-4d9e-88ec-332f45447f2a service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:36.924808 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df336e5-1c58-4d9e-88ec-332f45447f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:36.925086 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df336e5-1c58-4d9e-88ec-332f45447f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:36.936450 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df336e5-1c58-4d9e-88ec-332f45447f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:36.937973 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df336e5-1c58-4d9e-88ec-332f45447f2a service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:36.948718 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1434/2871] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:37.649265 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ad2ba-f3a2-47ba-9d2a-ebfdada40238 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:37.651050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-0b9ad2ba-f3a2-47ba-9d2a-ebfdada40238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:37.666999 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ad2ba-f3a2-47ba-9d2a-ebfdada40238 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:37.674080 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:37.675093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:37.675495 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:37.675967 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] PATH_INFO: `/v3/projects/c1740b8e05774f909954aa4dcca52d5e` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:37.677958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1740b8e05774f909954aa4dcca52d5e)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:37.681557 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:37.712718 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:37.870708 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1740b8e05774f909954aa4dcca52d5e', 'request_id': 'req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:37.876172 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1740b8e05774f909954aa4dcca52d5e', 'request_id': 'req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:37.882490 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1740b8e05774f909954aa4dcca52d5e', 'request_id': 'req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:38.047819 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] The token cache is being invalidate because project c1740b8e05774f909954aa4dcca52d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:38.048111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:38.048766 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-19be6c1d-a7d6-4b6f-ad33-12b1fa33cd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:38.050257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1438/2872] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:37 2022] DELETE /identity/v3/projects/c1740b8e05774f909954aa4dcca52d5e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:38.055345 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7f79b-f424-4ee4-b63d-725260e3d58b None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:38.055854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7f79b-f424-4ee4-b63d-725260e3d58b None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:38.055854 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7f79b-f424-4ee4-b63d-725260e3d58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:38.078656 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-86c7f79b-f424-4ee4-b63d-725260e3d58b None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:38.079974 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-86c7f79b-f424-4ee4-b63d-725260e3d58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:38.144290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1435/2873] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:05:38.152892 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ecd1f-3b3e-4b11-a742-b76b7abb10fd None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:38.153267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ecd1f-3b3e-4b11-a742-b76b7abb10fd None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:38.153540 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ecd1f-3b3e-4b11-a742-b76b7abb10fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:38.173340 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-5e3ecd1f-3b3e-4b11-a742-b76b7abb10fd None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:38.174555 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5e3ecd1f-3b3e-4b11-a742-b76b7abb10fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:38.183478 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1439/2874] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:38.188373 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7f79b-f424-4ee4-b63d-725260e3d58b None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:38.199050 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7f79b-f424-4ee4-b63d-725260e3d58b None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:38.203732 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbd664-799b-4e30-83ce-239c162dc3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:38.204369 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbd664-799b-4e30-83ce-239c162dc3be admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:38.204751 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbd664-799b-4e30-83ce-239c162dc3be admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:38.204966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbd664-799b-4e30-83ce-239c162dc3be admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:38.205665 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbd664-799b-4e30-83ce-239c162dc3be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:05:38.205975 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbd664-799b-4e30-83ce-239c162dc3be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:38.207582 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbd664-799b-4e30-83ce-239c162dc3be admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:38.220132 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1436/2875] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:05:38.224846 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ecd1f-3b3e-4b11-a742-b76b7abb10fd None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:38.234645 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ecd1f-3b3e-4b11-a742-b76b7abb10fd None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:38.239659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd59ef-ce86-4aaa-b98e-7480a49b8a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:38.240267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd59ef-ce86-4aaa-b98e-7480a49b8a93 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:38.240596 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd59ef-ce86-4aaa-b98e-7480a49b8a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:38.240995 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd59ef-ce86-4aaa-b98e-7480a49b8a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:38.241627 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd59ef-ce86-4aaa-b98e-7480a49b8a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:38.243530 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd59ef-ce86-4aaa-b98e-7480a49b8a93 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:38.356754 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1440/2876] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:38 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:38.357893 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbd664-799b-4e30-83ce-239c162dc3be admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:38.369197 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbd664-799b-4e30-83ce-239c162dc3be admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:38.382844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:38.428339 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8ebab-e37e-47fb-9c23-26296c0a601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:38.429047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ebab-e37e-47fb-9c23-26296c0a601b admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:38.429328 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ebab-e37e-47fb-9c23-26296c0a601b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:38.429650 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ebab-e37e-47fb-9c23-26296c0a601b admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:38.430280 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8ebab-e37e-47fb-9c23-26296c0a601b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:38.432201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8ebab-e37e-47fb-9c23-26296c0a601b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:38.567315 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1437/2877] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:38 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:38.571512 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd59ef-ce86-4aaa-b98e-7480a49b8a93 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:38.582620 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd59ef-ce86-4aaa-b98e-7480a49b8a93 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:38.587448 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9af9a9-ef90-45df-8b06-a3183f442b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:38.588116 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9af9a9-ef90-45df-8b06-a3183f442b53 admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:38.588392 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9af9a9-ef90-45df-8b06-a3183f442b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:38.589950 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9af9a9-ef90-45df-8b06-a3183f442b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:38.590613 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9af9a9-ef90-45df-8b06-a3183f442b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:38.592226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9af9a9-ef90-45df-8b06-a3183f442b53 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:38.603079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1441/2878] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:38.607417 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8ebab-e37e-47fb-9c23-26296c0a601b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:38.617612 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8ebab-e37e-47fb-9c23-26296c0a601b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:38.622841 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af300a-bbb7-4f23-97c1-d200e52f64ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:38.623440 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af300a-bbb7-4f23-97c1-d200e52f64ad admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:38.623714 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af300a-bbb7-4f23-97c1-d200e52f64ad admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:38.623983 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af300a-bbb7-4f23-97c1-d200e52f64ad admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:38.624645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af300a-bbb7-4f23-97c1-d200e52f64ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:38.626539 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af300a-bbb7-4f23-97c1-d200e52f64ad admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:38.638607 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1438/2879] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:38.642929 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9af9a9-ef90-45df-8b06-a3183f442b53 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:38.653781 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9af9a9-ef90-45df-8b06-a3183f442b53 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:38.658524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35082c65-e714-4be9-8bc0-c7dfdb514503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:38.660353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35082c65-e714-4be9-8bc0-c7dfdb514503 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:38.660353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35082c65-e714-4be9-8bc0-c7dfdb514503 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:38.660353 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35082c65-e714-4be9-8bc0-c7dfdb514503 admin admin] PATH_INFO: `/v3/projects/44f3260b59a94fcd9dd35d48353efad8/users/ba12007193dc40aa83ffcfda393e314e/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:38.676018 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35082c65-e714-4be9-8bc0-c7dfdb514503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f3260b59a94fcd9dd35d48353efad8, user_id=ba12007193dc40aa83ffcfda393e314e, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:38.678702 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35082c65-e714-4be9-8bc0-c7dfdb514503 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:38.801639 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1442/2880] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:38 2022] PUT /identity/v3/projects/44f3260b59a94fcd9dd35d48353efad8/users/ba12007193dc40aa83ffcfda393e314e/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:38.814352 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af0d6-b351-46ba-ab8b-56aee3fc096e None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:38.814631 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af0d6-b351-46ba-ab8b-56aee3fc096e None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:38.814902 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83af0d6-b351-46ba-ab8b-56aee3fc096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:38.843715 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-f83af0d6-b351-46ba-ab8b-56aee3fc096e None None] MFA Rules not processed for user `ba12007193dc40aa83ffcfda393e314e`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:38.844985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-f83af0d6-b351-46ba-ab8b-56aee3fc096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:38.916380 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1439/2881] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:38.929500 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35082c65-e714-4be9-8bc0-c7dfdb514503 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:38.931648 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-35082c65-e714-4be9-8bc0-c7dfdb514503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:38.991874 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35082c65-e714-4be9-8bc0-c7dfdb514503 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:38.996065 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445cc09-915a-4e57-af89-b1cdc7a3a9f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:38.996705 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445cc09-915a-4e57-af89-b1cdc7a3a9f1 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:38.996983 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445cc09-915a-4e57-af89-b1cdc7a3a9f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:38.997257 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445cc09-915a-4e57-af89-b1cdc7a3a9f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:39.006422 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445cc09-915a-4e57-af89-b1cdc7a3a9f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:39.007864 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445cc09-915a-4e57-af89-b1cdc7a3a9f1 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:39.017267 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1443/2882] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:39.043824 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af0d6-b351-46ba-ab8b-56aee3fc096e None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:39.110990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83af0d6-b351-46ba-ab8b-56aee3fc096e None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:39.115480 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:39.116112 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:39.116386 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:39.116694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] PATH_INFO: `/v3/users/ba12007193dc40aa83ffcfda393e314e` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:39.117802 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba12007193dc40aa83ffcfda393e314e)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:39.120325 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:39.226098 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:39.388183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba12007193dc40aa83ffcfda393e314e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:39.401396 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba12007193dc40aa83ffcfda393e314e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:39.555331 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba12007193dc40aa83ffcfda393e314e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:39.555966 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba12007193dc40aa83ffcfda393e314e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:39.563817 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba12007193dc40aa83ffcfda393e314e'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:39.569826 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1440/2883] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:39 2022] DELETE /identity/v3/users/ba12007193dc40aa83ffcfda393e314e => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:39.574527 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f0c26-279c-4d79-8417-b4f6bc50f556 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:39.574758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f0c26-279c-4d79-8417-b4f6bc50f556 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:39.574958 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f0c26-279c-4d79-8417-b4f6bc50f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:39.595605 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-fa4f0c26-279c-4d79-8417-b4f6bc50f556 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:39.596965 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fa4f0c26-279c-4d79-8417-b4f6bc50f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:39.641724 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:39.657390 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1444/2884] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:39.671734 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:39.673194 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:39.743809 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7035-5adf-4eef-b6bd-29cc8769bd75 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:39.747876 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209ba44-b4ea-4f84-8e37-675df41d0b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:39.748677 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209ba44-b4ea-4f84-8e37-675df41d0b7d service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:39.749234 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209ba44-b4ea-4f84-8e37-675df41d0b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:39.771463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209ba44-b4ea-4f84-8e37-675df41d0b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:39.771463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209ba44-b4ea-4f84-8e37-675df41d0b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:39.771463 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209ba44-b4ea-4f84-8e37-675df41d0b7d service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:39.772533 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1441/2885] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:40.409069 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f0c26-279c-4d79-8417-b4f6bc50f556 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:40.413822 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-fa4f0c26-279c-4d79-8417-b4f6bc50f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:40.425002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f0c26-279c-4d79-8417-b4f6bc50f556 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:40.429876 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:40.430520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:40.430881 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:40.431056 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] PATH_INFO: `/v3/projects/44f3260b59a94fcd9dd35d48353efad8` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:40.432839 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f3260b59a94fcd9dd35d48353efad8)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:40.434821 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:40.602795 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f3260b59a94fcd9dd35d48353efad8', 'request_id': 'req-2e17139e-a275-4ac4-b582-43a3dad50986'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:40.608165 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f3260b59a94fcd9dd35d48353efad8', 'request_id': 'req-2e17139e-a275-4ac4-b582-43a3dad50986'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:40.614495 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f3260b59a94fcd9dd35d48353efad8', 'request_id': 'req-2e17139e-a275-4ac4-b582-43a3dad50986'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:40.778479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] The token cache is being invalidate because project 44f3260b59a94fcd9dd35d48353efad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:40.778802 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:40.779403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-2e17139e-a275-4ac4-b582-43a3dad50986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:40.780937 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1445/2886] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:40 2022] DELETE /identity/v3/projects/44f3260b59a94fcd9dd35d48353efad8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:42.479531 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209ba44-b4ea-4f84-8e37-675df41d0b7d service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:42.481138 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-0209ba44-b4ea-4f84-8e37-675df41d0b7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:42.495049 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209ba44-b4ea-4f84-8e37-675df41d0b7d service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:42.569338 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:42.569984 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:42.570264 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:42.570538 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] PATH_INFO: `/v3/users/0c095566e877484c9d371ee751835fd0` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:42.571721 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c095566e877484c9d371ee751835fd0)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:42.574329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:42.824497 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c095566e877484c9d371ee751835fd0'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:42.826793 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:42.837686 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c095566e877484c9d371ee751835fd0'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:42.921030 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c095566e877484c9d371ee751835fd0'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:42.921640 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c095566e877484c9d371ee751835fd0'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:42.929633 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c095566e877484c9d371ee751835fd0'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:42.936708 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1442/2887] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:42 2022] DELETE /identity/v3/users/0c095566e877484c9d371ee751835fd0 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:42.945735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f03a1-f959-4ecb-9a53-83b3ddc923c0 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:42.945735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f03a1-f959-4ecb-9a53-83b3ddc923c0 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:42.945735 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f03a1-f959-4ecb-9a53-83b3ddc923c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:42.962346 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-1d6f03a1-f959-4ecb-9a53-83b3ddc923c0 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:42.963674 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1d6f03a1-f959-4ecb-9a53-83b3ddc923c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:43.026343 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1446/2888] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:43.036476 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:43.037967 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:43.101864 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cd85a-979a-4282-b306-f8515dc54e06 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:43.106074 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1750589-8935-4814-a426-0dfdaf03b9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:43.106781 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750589-8935-4814-a426-0dfdaf03b9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:43.107099 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750589-8935-4814-a426-0dfdaf03b9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:43.107375 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750589-8935-4814-a426-0dfdaf03b9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:43.117622 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1750589-8935-4814-a426-0dfdaf03b9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:43.119199 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1750589-8935-4814-a426-0dfdaf03b9e7 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:43.129847 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1443/2889] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:43.614093 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f03a1-f959-4ecb-9a53-83b3ddc923c0 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:43.615659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-1d6f03a1-f959-4ecb-9a53-83b3ddc923c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:43.628878 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f03a1-f959-4ecb-9a53-83b3ddc923c0 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:43.635524 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:43.636184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:43.636467 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:43.636773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] PATH_INFO: `/v3/projects/bb62799270374c39a4fc898df07ca598` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:43.643933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb62799270374c39a4fc898df07ca598)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:43.643933 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:43.819480 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb62799270374c39a4fc898df07ca598', 'request_id': 'req-5c713810-c7f6-49e2-b11a-5adfa393a53e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:43.825577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb62799270374c39a4fc898df07ca598', 'request_id': 'req-5c713810-c7f6-49e2-b11a-5adfa393a53e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:43.831946 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb62799270374c39a4fc898df07ca598', 'request_id': 'req-5c713810-c7f6-49e2-b11a-5adfa393a53e'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:43.835837 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:43.973194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] The token cache is being invalidate because project bb62799270374c39a4fc898df07ca598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:43.973803 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:43.974183 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-5c713810-c7f6-49e2-b11a-5adfa393a53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:43.975697 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1447/2890] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:43 2022] DELETE /identity/v3/projects/bb62799270374c39a4fc898df07ca598 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:43.980778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a69cce-3915-431b-af9e-1d58e736fff2 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:43.983540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a69cce-3915-431b-af9e-1d58e736fff2 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:43.983540 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a69cce-3915-431b-af9e-1d58e736fff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:44.005329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-59a69cce-3915-431b-af9e-1d58e736fff2 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:44.006535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-59a69cce-3915-431b-af9e-1d58e736fff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:44.070431 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1444/2891] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:44.078813 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f131e4-9c38-4f21-af87-1aad8925240c None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:44.079102 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f131e4-9c38-4f21-af87-1aad8925240c None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:44.079380 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f131e4-9c38-4f21-af87-1aad8925240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:44.100898 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-24f131e4-9c38-4f21-af87-1aad8925240c None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:44.102188 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-24f131e4-9c38-4f21-af87-1aad8925240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:44.111336 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1448/2892] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:44.115738 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a69cce-3915-431b-af9e-1d58e736fff2 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:44.126183 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a69cce-3915-431b-af9e-1d58e736fff2 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:44.130952 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530009-31c8-4ca4-9141-01e83eeecd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:44.131569 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530009-31c8-4ca4-9141-01e83eeecd24 admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:44.131844 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530009-31c8-4ca4-9141-01e83eeecd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:44.132111 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93530009-31c8-4ca4-9141-01e83eeecd24 admin admin] PATH_INFO: `/v3/domains` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:44.132794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93530009-31c8-4ca4-9141-01e83eeecd24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:05:44.133095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93530009-31c8-4ca4-9141-01e83eeecd24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:44.134694 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93530009-31c8-4ca4-9141-01e83eeecd24 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:44.147772 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1445/2893] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 16:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:05:44.153213 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f131e4-9c38-4f21-af87-1aad8925240c None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:44.163807 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f131e4-9c38-4f21-af87-1aad8925240c None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:44.170394 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e39c49-6e11-4982-bc3c-7e4fe390cf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:44.171231 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e39c49-6e11-4982-bc3c-7e4fe390cf04 admin admin] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:44.171695 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e39c49-6e11-4982-bc3c-7e4fe390cf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:44.172111 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e39c49-6e11-4982-bc3c-7e4fe390cf04 admin admin] PATH_INFO: `/v3/projects` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:44.172827 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e39c49-6e11-4982-bc3c-7e4fe390cf04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:44.175801 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e39c49-6e11-4982-bc3c-7e4fe390cf04 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:44.283542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1449/2894] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:44 2022] POST /identity/v3/projects => generated 399 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:44.288330 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530009-31c8-4ca4-9141-01e83eeecd24 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:44.299350 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93530009-31c8-4ca4-9141-01e83eeecd24 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:44.355710 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:44.362556 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a296d-6017-411f-873b-61c3a34d479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:44.363180 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a296d-6017-411f-873b-61c3a34d479b admin admin] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:44.368128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a296d-6017-411f-873b-61c3a34d479b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:44.368128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a296d-6017-411f-873b-61c3a34d479b admin admin] PATH_INFO: `/v3/users` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:44.368128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a296d-6017-411f-873b-61c3a34d479b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:44.368128 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a296d-6017-411f-873b-61c3a34d479b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:44.487459 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1446/2895] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:44 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:44.491753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e39c49-6e11-4982-bc3c-7e4fe390cf04 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:44.502952 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e39c49-6e11-4982-bc3c-7e4fe390cf04 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:44.507681 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6faa9d-4893-4760-84c8-cf4e3252506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:44.508341 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6faa9d-4893-4760-84c8-cf4e3252506b admin admin] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:44.508659 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6faa9d-4893-4760-84c8-cf4e3252506b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:44.508927 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6faa9d-4893-4760-84c8-cf4e3252506b admin admin] PATH_INFO: `/v3/roles` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:44.509569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6faa9d-4893-4760-84c8-cf4e3252506b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:44.511194 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6faa9d-4893-4760-84c8-cf4e3252506b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:44.524168 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1450/2896] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:44.529932 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a296d-6017-411f-873b-61c3a34d479b admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:44.544196 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a296d-6017-411f-873b-61c3a34d479b admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:44.547312 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e5758-2770-49a1-8dfa-fd7b980faa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:44.547937 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5758-2770-49a1-8dfa-fd7b980faa3b admin admin] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:44.548314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5758-2770-49a1-8dfa-fd7b980faa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:44.548618 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5758-2770-49a1-8dfa-fd7b980faa3b admin admin] PATH_INFO: `/v3/roles` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:44.549268 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e5758-2770-49a1-8dfa-fd7b980faa3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:44.550861 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e5758-2770-49a1-8dfa-fd7b980faa3b admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:44.562013 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1447/2897] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:44.566472 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6faa9d-4893-4760-84c8-cf4e3252506b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:44.576833 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6faa9d-4893-4760-84c8-cf4e3252506b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:44.582619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076778f-2d1e-41b9-9fae-740a404c5e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:44.583551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076778f-2d1e-41b9-9fae-740a404c5e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:44.584002 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076778f-2d1e-41b9-9fae-740a404c5e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:44.584281 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076778f-2d1e-41b9-9fae-740a404c5e00 admin admin] PATH_INFO: `/v3/projects/f798cd4443e54d24b9df5356a9594b2a/users/2abbd40570c44aa3af918cdd3d5eeeac/roles/23c81c3dc8f743289ecb566849eb8324` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:44.600619 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076778f-2d1e-41b9-9fae-740a404c5e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f798cd4443e54d24b9df5356a9594b2a, user_id=2abbd40570c44aa3af918cdd3d5eeeac, role_id=23c81c3dc8f743289ecb566849eb8324)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:44.603287 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076778f-2d1e-41b9-9fae-740a404c5e00 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:44.740962 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1451/2898] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:44 2022] PUT /identity/v3/projects/f798cd4443e54d24b9df5356a9594b2a/users/2abbd40570c44aa3af918cdd3d5eeeac/roles/23c81c3dc8f743289ecb566849eb8324 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:44.751635 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936afab2-c690-4c4b-8f88-721209f2ced6 None None] REQUEST_METHOD: `POST` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:44.751926 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936afab2-c690-4c4b-8f88-721209f2ced6 None None] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:44.752294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936afab2-c690-4c4b-8f88-721209f2ced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:44.785667 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.auth.core [None req-936afab2-c690-4c4b-8f88-721209f2ced6 None None] MFA Rules not processed for user `2abbd40570c44aa3af918cdd3d5eeeac`. Rule list: `[]` (Enabled: `True`). {{(pid=98422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:44.787095 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-936afab2-c690-4c4b-8f88-721209f2ced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:44.860980 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1448/2899] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:44.873570 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076778f-2d1e-41b9-9fae-740a404c5e00 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:44.878368 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-b076778f-2d1e-41b9-9fae-740a404c5e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:44.969917 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076778f-2d1e-41b9-9fae-740a404c5e00 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:44.973632 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397f8c4-97ed-4229-87d6-40eb0103fec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8d073f3152f4825becf78c24539477e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:44.974273 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397f8c4-97ed-4229-87d6-40eb0103fec5 service cinder] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:44.974502 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397f8c4-97ed-4229-87d6-40eb0103fec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:44.974773 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397f8c4-97ed-4229-87d6-40eb0103fec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:44.983947 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397f8c4-97ed-4229-87d6-40eb0103fec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:44.985456 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397f8c4-97ed-4229-87d6-40eb0103fec5 service cinder] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:44.994902 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1452/2900] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:50.956085 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936afab2-c690-4c4b-8f88-721209f2ced6 None None] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:51.027706 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936afab2-c690-4c4b-8f88-721209f2ced6 None None] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:51.035225 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:51.036308 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:51.036898 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:51.037329 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] PATH_INFO: `/v3/users/2abbd40570c44aa3af918cdd3d5eeeac` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:51.039290 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2abbd40570c44aa3af918cdd3d5eeeac)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:51.043427 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:51.209366 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2abbd40570c44aa3af918cdd3d5eeeac'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:51.221357 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2abbd40570c44aa3af918cdd3d5eeeac'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:51.223874 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:51.315482 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2abbd40570c44aa3af918cdd3d5eeeac'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:51.316310 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2abbd40570c44aa3af918cdd3d5eeeac'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:51.324960 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2abbd40570c44aa3af918cdd3d5eeeac'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:51.331486 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1449/2901] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:50 2022] DELETE /identity/v3/users/2abbd40570c44aa3af918cdd3d5eeeac => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:51.336090 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13286f-c4a2-4c4f-a4d5-fd72ea437ae8 None None] REQUEST_METHOD: `POST` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:51.336771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13286f-c4a2-4c4f-a4d5-fd72ea437ae8 None None] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:51.336771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13286f-c4a2-4c4f-a4d5-fd72ea437ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:51.357520 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.auth.core [None req-3a13286f-c4a2-4c4f-a4d5-fd72ea437ae8 None None] MFA Rules not processed for user `b59293d8226b4fba854dac5ea94dd380`. Rule list: `[]` (Enabled: `True`). {{(pid=98421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:51.358842 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3a13286f-c4a2-4c4f-a4d5-fd72ea437ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:51.420569 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1453/2902] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 16:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:51.430279 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:51.431759 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:51.491053 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fed04e-d366-471a-9fba-d452b4b057f0 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:51.494904 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35ea88-7a42-4c6e-8616-72c4b1ff4c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:51.495505 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35ea88-7a42-4c6e-8616-72c4b1ff4c19 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:51.495778 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35ea88-7a42-4c6e-8616-72c4b1ff4c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:51.496042 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35ea88-7a42-4c6e-8616-72c4b1ff4c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:51.505892 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35ea88-7a42-4c6e-8616-72c4b1ff4c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:51.507321 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35ea88-7a42-4c6e-8616-72c4b1ff4c19 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:51.516920 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1450/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:51.997565 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13286f-c4a2-4c4f-a4d5-fd72ea437ae8 None None] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:51.999079 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3a13286f-c4a2-4c4f-a4d5-fd72ea437ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:52.012167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13286f-c4a2-4c4f-a4d5-fd72ea437ae8 None None] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:52.016823 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:52.017457 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:52.017852 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:52.018021 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] PATH_INFO: `/v3/projects/f798cd4443e54d24b9df5356a9594b2a` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:52.019223 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f798cd4443e54d24b9df5356a9594b2a)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:52.021945 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:52.032381 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:52.156064 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f798cd4443e54d24b9df5356a9594b2a', 'request_id': 'req-3c61297e-8942-453b-b72f-84a5622fe47b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:52.161758 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f798cd4443e54d24b9df5356a9594b2a', 'request_id': 'req-3c61297e-8942-453b-b72f-84a5622fe47b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:52.168158 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f798cd4443e54d24b9df5356a9594b2a', 'request_id': 'req-3c61297e-8942-453b-b72f-84a5622fe47b'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:52.246866 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] The token cache is being invalidate because project f798cd4443e54d24b9df5356a9594b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:52.247153 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:52.247780 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:52.249307 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1454/2904] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:51 2022] DELETE /identity/v3/projects/f798cd4443e54d24b9df5356a9594b2a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:06:01.512643 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:DELETE=1,keystone:SELECT=32 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:02.243066 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:05.330165 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35ea88-7a42-4c6e-8616-72c4b1ff4c19 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:06:05.339628 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35ea88-7a42-4c6e-8616-72c4b1ff4c19 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:06:05.392078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da71f8-2e46-4c81-b5c8-ee5250248c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:06:05.392728 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da71f8-2e46-4c81-b5c8-ee5250248c35 service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:05.393005 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da71f8-2e46-4c81-b5c8-ee5250248c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:05.393274 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da71f8-2e46-4c81-b5c8-ee5250248c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:05.395032 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-28da71f8-2e46-4c81-b5c8-ee5250248c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:06:05.404769 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da71f8-2e46-4c81-b5c8-ee5250248c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:06:05.406201 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da71f8-2e46-4c81-b5c8-ee5250248c35 service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:06:05.415125 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1451/2905] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:06:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:06:05.490466 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:06:05.491980 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:06:05.504641 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61297e-8942-453b-b72f-84a5622fe47b admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:06:05.508248 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc821c7-3699-4a06-b19e-7e2b74f81039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:06:05.508884 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc821c7-3699-4a06-b19e-7e2b74f81039 service neutron] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:05.509162 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc821c7-3699-4a06-b19e-7e2b74f81039 service neutron] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:05.509432 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc821c7-3699-4a06-b19e-7e2b74f81039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:05.511291 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5bc821c7-3699-4a06-b19e-7e2b74f81039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:06:05.607124 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc821c7-3699-4a06-b19e-7e2b74f81039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:06:05.608455 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc821c7-3699-4a06-b19e-7e2b74f81039 service neutron] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:06:05.629226 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1455/2906] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:06:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:06:15.410816 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=26 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:15.626546 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=46 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:24.877314 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da71f8-2e46-4c81-b5c8-ee5250248c35 service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:24.879019 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-28da71f8-2e46-4c81-b5c8-ee5250248c35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:24.889725 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da71f8-2e46-4c81-b5c8-ee5250248c35 service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:24.893578 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42386c-8e1c-4881-9ca6-1b8f4233750e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90324fa56d0743699f2fddd17fb630dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:24.894719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42386c-8e1c-4881-9ca6-1b8f4233750e service neutron] REQUEST_METHOD: `GET` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:24.894719 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42386c-8e1c-4881-9ca6-1b8f4233750e service neutron] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:24.894990 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42386c-8e1c-4881-9ca6-1b8f4233750e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:24.897017 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-2b42386c-8e1c-4881-9ca6-1b8f4233750e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:24.911796 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42386c-8e1c-4881-9ca6-1b8f4233750e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:24.913294 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42386c-8e1c-4881-9ca6-1b8f4233750e service neutron] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:24.925611 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1452/2907] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:34.708931 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc821c7-3699-4a06-b19e-7e2b74f81039 service neutron] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:34.710410 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-5bc821c7-3699-4a06-b19e-7e2b74f81039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:34.777771 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc821c7-3699-4a06-b19e-7e2b74f81039 service neutron] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:34.782403 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:34.783029 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:34.783309 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:34.783577 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] PATH_INFO: `/v3/users/d431e38e573d4c79a1343cea1153d05f` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:34.784730 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d431e38e573d4c79a1343cea1153d05f)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:34.786672 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:34.916184 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd431e38e573d4c79a1343cea1153d05f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:34.920317 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=6 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:34.924217 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd431e38e573d4c79a1343cea1153d05f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.033688 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd431e38e573d4c79a1343cea1153d05f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.034325 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd431e38e573d4c79a1343cea1153d05f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.034938 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd431e38e573d4c79a1343cea1153d05f'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.054663 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1456/2908] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:07:34 2022] DELETE /identity/v3/users/d431e38e573d4c79a1343cea1153d05f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:35.303908 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42386c-8e1c-4881-9ca6-1b8f4233750e service neutron] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:35.316825 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42386c-8e1c-4881-9ca6-1b8f4233750e service neutron] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:35.380519 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:35.381303 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:35.381490 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:35.381760 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] PATH_INFO: `/v3/projects/c0d518cc1cfb4d89a8ccdda6ee92c6bb` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:35.382867 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d518cc1cfb4d89a8ccdda6ee92c6bb)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:35.384794 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:35.502047 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d518cc1cfb4d89a8ccdda6ee92c6bb', 'request_id': 'req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.559301 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d518cc1cfb4d89a8ccdda6ee92c6bb', 'request_id': 'req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.566175 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d518cc1cfb4d89a8ccdda6ee92c6bb', 'request_id': 'req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.576921 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] The token cache is being invalidate because project c0d518cc1cfb4d89a8ccdda6ee92c6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:07:35.577204 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.577866 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.579319 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1453/2909] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:07:35 2022] DELETE /identity/v3/projects/c0d518cc1cfb4d89a8ccdda6ee92c6bb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:35.583465 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:35.584912 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:35.598542 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965963-d04a-4ab0-9012-f0f3aeccfea6 admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:35.656479 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:35.657146 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:35.657423 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:35.657691 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] PATH_INFO: `/v3/users/2baec4f8f6a24d6caecda9195d271074` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:35.658809 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2baec4f8f6a24d6caecda9195d271074)` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:35.660753 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:35.682562 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:35.875585 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2baec4f8f6a24d6caecda9195d271074'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.882167 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2baec4f8f6a24d6caecda9195d271074'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.948796 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2baec4f8f6a24d6caecda9195d271074'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.949416 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2baec4f8f6a24d6caecda9195d271074'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.950050 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.notifications [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2baec4f8f6a24d6caecda9195d271074'} {{(pid=98421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:35.968689 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1457/2910] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 16:07:35 2022] DELETE /identity/v3/users/2baec4f8f6a24d6caecda9195d271074 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:36.201465 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] Authenticating user token {{(pid=98422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:36.203102 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.fernet_utils [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:36.218814 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9d93a-8ad3-4ad3-952d-8e720d94e824 admin admin] Validating token access rules against request {{(pid=98422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:36.277433 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59293d8226b4fba854dac5ea94dd380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01b431c789654fc6addb5ceef4aa5682', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:36.277988 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:36.278263 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:36.278535 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] PATH_INFO: `/v3/projects/4b3167a80a3c461480ce2702f0153997` {{(pid=98422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:36.279645 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3167a80a3c461480ce2702f0153997)` {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:36.281692 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] RBAC: Authorization granted {{(pid=98422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:36.348757 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:36.361153 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3167a80a3c461480ce2702f0153997', 'request_id': 'req-3df82ccc-966e-4703-8ad3-22951a1a1c80'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.417886 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3167a80a3c461480ce2702f0153997', 'request_id': 'req-3df82ccc-966e-4703-8ad3-22951a1a1c80'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.425190 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3167a80a3c461480ce2702f0153997', 'request_id': 'req-3df82ccc-966e-4703-8ad3-22951a1a1c80'} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.435985 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] The token cache is being invalidate because project 4b3167a80a3c461480ce2702f0153997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:07:36.436275 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.437235 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG keystone.notifications [None req-3df82ccc-966e-4703-8ad3-22951a1a1c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.438735 dv-cinder-842541-5-smb devstack@keystone.service[98422]: [pid: 98422|app: 0|req: 1454/2911] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 16:07:36 2022] DELETE /identity/v3/projects/4b3167a80a3c461480ce2702f0153997 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:45.965510 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:46.600078 dv-cinder-842541-5-smb devstack@keystone.service[98422]: DEBUG dbcounter [-] [98422] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=98422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:31.293243 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] Authenticating user token {{(pid=98421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:31.295611 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:31.383551 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc977e-5cb0-42bc-b7b6-80dcc4853c4d admin admin] Validating token access rules against request {{(pid=98421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:31.492335 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbbdea-4aa1-4545-b126-8b99c694527a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ecb4e7e9e3042adadd93229f8456eca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'daa3335d89fb42ec8ac663773f411098', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:31.493460 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbbdea-4aa1-4545-b126-8b99c694527a service placement] REQUEST_METHOD: `GET` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:31.493937 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbbdea-4aa1-4545-b126-8b99c694527a service placement] SCRIPT_NAME: `/identity` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:31.494430 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbbdea-4aa1-4545-b126-8b99c694527a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:31.497804 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.fernet_utils [None req-d2dbbdea-4aa1-4545-b126-8b99c694527a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:31.519652 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbbdea-4aa1-4545-b126-8b99c694527a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:31.521400 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbbdea-4aa1-4545-b126-8b99c694527a service placement] RBAC: Authorization granted {{(pid=98421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:31.533589 dv-cinder-842541-5-smb devstack@keystone.service[98421]: [pid: 98421|app: 0|req: 1458/2912] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 16:10:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:10:41.528096 dv-cinder-842541-5-smb devstack@keystone.service[98421]: DEBUG dbcounter [-] [98421] Writing DB stats keystone:SELECT=58 {{(pid=98421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}